2026-03-28 07:30:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 07:30:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 07:30:05 [auto1.de] INFO: Batch mode enabled: batch 1/2
2026-03-28 07:30:05 [auto1.de] INFO: Starting spider auto1.de
2026-03-28 07:30:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 07:30:05 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 07:30:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 07:30:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 07:30:05 [scrapy.extensions.telnet] INFO: Telnet Password: ff182a220d6ab639
2026-03-28 07:30:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-28 07:30:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.de/task_17_2026-03-28T07_30_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-28 07:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 07:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 07:30:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 07:30:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 07:30:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 07:30:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-28 07:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 07:30:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2121
2026-03-28 07:30:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 07:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 07:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 07:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 07:30:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 07:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 07:30:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 07:30:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 07:30:06 [scrapy.core.engine] INFO: Spider opened
2026-03-28 07:30:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 07:30:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 07:30:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-28 07:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 07:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 07:30:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:30:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 07:30:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:30:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 07:30:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:30:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 07:30:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:30:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 07:30:19 [auto1.de] INFO: Channel: 24h | Page: 0 | totalHits: 9246 | hits on page: 40
2026-03-28 07:30:19 [auto1.de] INFO: Found listing with ID: WJ88731
2026-03-28 07:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ88731%27 HTTP/1.1" 200 None
2026-03-28 07:30:19 [auto1.de] INFO: Scrape type for WJ88731: 2
2026-03-28 07:30:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57e7d92d-40dc-520a-bd63-40bdfa513f52 with identifier: WJ88731
2026-03-28 07:30:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57e7d92d-40dc-520a-bd63-40bdfa513f52 with scrape type 2
2026-03-28 07:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57e7d92d-40dc-520a-bd63-40bdfa513f52 with scrape type 2
2026-03-28 07:30:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57e7d92d-40dc-520a-bd63-40bdfa513f52, identifier: WJ88731
2026-03-28 07:30:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57e7d92d-40dc-520a-bd63-40bdfa513f52 with identifier: WJ88731
2026-03-28 07:30:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:30:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 07:30:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:30:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:30:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 07:30:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:30:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57e7d92d-40dc-520a-bd63-40bdfa513f52 with identifier: WJ88731
2026-03-28 07:30:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57e7d92d-40dc-520a-bd63-40bdfa513f52 with identifier: WJ88731 to the API
2026-03-28 07:30:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:32:02Z',
'fuel_type': 'diesel',
'id': '57e7d92d-40dc-520a-bd63-40bdfa513f52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ88731',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 224746,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-20',
'seller_name': None,
'title': 'Audi A3 Sportback 1.6 TDIe Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2010}
2026-03-28 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ88731%27 HTTP/1.1" 200 None
2026-03-28 07:30:21 [auto1.de] INFO: Saving data for WJ88731: {'auction_closing_time': 1774884722.0, 'created_time': 1774349360.183378, 'last_price_update_time': 1774683021.105589}
2026-03-28 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ88731') HTTP/1.1" 204 0
2026-03-28 07:30:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:30:21 [auto1.de] INFO: Found listing with ID: GY05092
2026-03-28 07:30:21 [auto1.de] INFO: Found listing with ID: NH74932
2026-03-28 07:30:21 [auto1.de] INFO: Found listing with ID: WA60872
2026-03-28 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA60872%27 HTTP/1.1" 200 None
2026-03-28 07:30:21 [auto1.de] INFO: Scrape type for WA60872: 2
2026-03-28 07:30:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a7e9528-bd23-5cf0-84bc-d15e226d5405 with identifier: WA60872
2026-03-28 07:30:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a7e9528-bd23-5cf0-84bc-d15e226d5405 with scrape type 2
2026-03-28 07:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a7e9528-bd23-5cf0-84bc-d15e226d5405 with scrape type 2
2026-03-28 07:30:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a7e9528-bd23-5cf0-84bc-d15e226d5405, identifier: WA60872
2026-03-28 07:30:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a7e9528-bd23-5cf0-84bc-d15e226d5405 with identifier: WA60872
2026-03-28 07:30:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:30:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 07:30:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:30:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:30:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 07:30:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:30:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a7e9528-bd23-5cf0-84bc-d15e226d5405 with identifier: WA60872
2026-03-28 07:30:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a7e9528-bd23-5cf0-84bc-d15e226d5405 with identifier: WA60872 to the API
2026-03-28 07:30:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:38:10Z',
'fuel_type': 'petrol',
'id': '1a7e9528-bd23-5cf0-84bc-d15e226d5405',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA60872',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 112988,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-08',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-28 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA60872%27 HTTP/1.1" 200 None
2026-03-28 07:30:21 [auto1.de] INFO: Saving data for WA60872: {'auction_closing_time': 1774885090.0, 'created_time': 1773467701.248596, 'last_price_update_time': 1774683021.877318}
2026-03-28 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA60872') HTTP/1.1" 204 0
2026-03-28 07:30:21 [auto1.de] INFO: Found listing with ID: PC86018
2026-03-28 07:30:21 [auto1.de] INFO: Found listing with ID: EE70645
2026-03-28 07:30:21 [auto1.de] INFO: Found listing with ID: RJ17594
2026-03-28 07:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ17594%27 HTTP/1.1" 200 None
2026-03-28 07:30:22 [auto1.de] INFO: Scrape type for RJ17594: 2
2026-03-28 07:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e839da47-a265-5073-a3c9-e1f3fcc66791 with identifier: RJ17594
2026-03-28 07:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e839da47-a265-5073-a3c9-e1f3fcc66791 with scrape type 2
2026-03-28 07:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e839da47-a265-5073-a3c9-e1f3fcc66791 with scrape type 2
2026-03-28 07:30:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e839da47-a265-5073-a3c9-e1f3fcc66791, identifier: RJ17594
2026-03-28 07:30:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e839da47-a265-5073-a3c9-e1f3fcc66791 with identifier: RJ17594
2026-03-28 07:30:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e839da47-a265-5073-a3c9-e1f3fcc66791 with identifier: RJ17594
2026-03-28 07:30:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e839da47-a265-5073-a3c9-e1f3fcc66791 with identifier: RJ17594 to the API
2026-03-28 07:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:41:15Z',
'fuel_type': 'petrol',
'id': 'e839da47-a265-5073-a3c9-e1f3fcc66791',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ17594',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 134468,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-21',
'seller_name': None,
'title': 'BMW 3er 325i',
'transmission': 'automatic',
'trim': '',
'year': 2010}
2026-03-28 07:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ17594%27 HTTP/1.1" 200 None
2026-03-28 07:30:23 [auto1.de] INFO: Saving data for RJ17594: {'auction_closing_time': 1774885275.0, 'created_time': 1774032970.814148, 'last_price_update_time': 1774683023.445797}
2026-03-28 07:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ17594') HTTP/1.1" 204 0
2026-03-28 07:30:23 [auto1.de] INFO: Found listing with ID: WC98530
2026-03-28 07:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC98530%27 HTTP/1.1" 200 None
2026-03-28 07:30:23 [auto1.de] INFO: Scrape type for WC98530: 2
2026-03-28 07:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c67fdd3d-1904-5dd2-9b74-02e70968d0cd with identifier: WC98530
2026-03-28 07:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c67fdd3d-1904-5dd2-9b74-02e70968d0cd with scrape type 2
2026-03-28 07:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c67fdd3d-1904-5dd2-9b74-02e70968d0cd with scrape type 2
2026-03-28 07:30:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c67fdd3d-1904-5dd2-9b74-02e70968d0cd, identifier: WC98530
2026-03-28 07:30:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c67fdd3d-1904-5dd2-9b74-02e70968d0cd with identifier: WC98530
2026-03-28 07:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:30:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 07:30:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:30:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c67fdd3d-1904-5dd2-9b74-02e70968d0cd with identifier: WC98530
2026-03-28 07:30:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c67fdd3d-1904-5dd2-9b74-02e70968d0cd with identifier: WC98530 to the API
2026-03-28 07:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:34:16Z',
'fuel_type': 'petrol',
'id': 'c67fdd3d-1904-5dd2-9b74-02e70968d0cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC98530',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 158677,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-13',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 TGDI Style 2WD',
'transmission': 'manual',
'trim': 'Style 2WD',
'year': 2016}
2026-03-28 07:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC98530%27 HTTP/1.1" 200 None
2026-03-28 07:30:24 [auto1.de] INFO: Saving data for WC98530: {'auction_closing_time': 1774884856.0, 'created_time': 1773467740.019583, 'last_price_update_time': 1774683024.07345}
2026-03-28 07:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC98530') HTTP/1.1" 204 0
2026-03-28 07:30:24 [auto1.de] INFO: Found listing with ID: ET93890
2026-03-28 07:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET93890%27 HTTP/1.1" 200 None
2026-03-28 07:30:24 [auto1.de] INFO: Scrape type for ET93890: 2
2026-03-28 07:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b65f4b38-f73c-522e-b3fd-0c404dc63004 with identifier: ET93890
2026-03-28 07:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b65f4b38-f73c-522e-b3fd-0c404dc63004 with scrape type 2
2026-03-28 07:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b65f4b38-f73c-522e-b3fd-0c404dc63004 with scrape type 2
2026-03-28 07:30:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b65f4b38-f73c-522e-b3fd-0c404dc63004, identifier: ET93890
2026-03-28 07:30:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b65f4b38-f73c-522e-b3fd-0c404dc63004 with identifier: ET93890
2026-03-28 07:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:30:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 07:30:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:30:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b65f4b38-f73c-522e-b3fd-0c404dc63004 with identifier: ET93890
2026-03-28 07:30:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b65f4b38-f73c-522e-b3fd-0c404dc63004 with identifier: ET93890 to the API
2026-03-28 07:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:48:02Z',
'fuel_type': 'petrol',
'id': 'b65f4b38-f73c-522e-b3fd-0c404dc63004',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET93890',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 113804,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-10-31',
'seller_name': None,
'title': 'Ford Fiesta 1.25 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2010}
2026-03-28 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET93890%27 HTTP/1.1" 200 None
2026-03-28 07:30:25 [auto1.de] INFO: Saving data for ET93890: {'auction_closing_time': 1774885682.0, 'created_time': 1774118797.859971, 'last_price_update_time': 1774683025.818605}
2026-03-28 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ET93890') HTTP/1.1" 204 0
2026-03-28 07:30:25 [auto1.de] INFO: Found listing with ID: DV01854
2026-03-28 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV01854%27 HTTP/1.1" 200 None
2026-03-28 07:30:25 [auto1.de] INFO: Scrape type for DV01854: 2
2026-03-28 07:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 354d9018-5234-551b-b3e4-d3a6ed7c5ad4 with identifier: DV01854
2026-03-28 07:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 354d9018-5234-551b-b3e4-d3a6ed7c5ad4 with scrape type 2
2026-03-28 07:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 354d9018-5234-551b-b3e4-d3a6ed7c5ad4 with scrape type 2
2026-03-28 07:30:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 354d9018-5234-551b-b3e4-d3a6ed7c5ad4, identifier: DV01854
2026-03-28 07:30:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 354d9018-5234-551b-b3e4-d3a6ed7c5ad4 with identifier: DV01854
2026-03-28 07:30:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 354d9018-5234-551b-b3e4-d3a6ed7c5ad4 with identifier: DV01854
2026-03-28 07:30:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 354d9018-5234-551b-b3e4-d3a6ed7c5ad4 with identifier: DV01854 to the API
2026-03-28 07:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:47:44Z',
'fuel_type': 'petrol',
'id': '354d9018-5234-551b-b3e4-d3a6ed7c5ad4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV01854',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 98909,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-28',
'seller_name': None,
'title': 'Nissan Qashqai 1.2 Tekna',
'transmission': 'automatic',
'trim': 'Tekna',
'year': 2017}
2026-03-28 07:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV01854%27 HTTP/1.1" 200 None
2026-03-28 07:30:27 [auto1.de] INFO: Saving data for DV01854: {'auction_closing_time': 1774885664.0, 'created_time': 1774031526.51608, 'last_price_update_time': 1774683027.072312}
2026-03-28 07:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV01854') HTTP/1.1" 204 0
2026-03-28 07:30:27 [auto1.de] INFO: Found listing with ID: GV87257
2026-03-28 07:30:27 [auto1.de] INFO: Found listing with ID: UE23148
2026-03-28 07:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE23148%27 HTTP/1.1" 200 None
2026-03-28 07:30:27 [auto1.de] INFO: Scrape type for UE23148: 2
2026-03-28 07:30:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94f7b76f-04a9-586f-8ca0-47c78321bc64 with identifier: UE23148
2026-03-28 07:30:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94f7b76f-04a9-586f-8ca0-47c78321bc64 with scrape type 2
2026-03-28 07:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94f7b76f-04a9-586f-8ca0-47c78321bc64 with scrape type 2
2026-03-28 07:30:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94f7b76f-04a9-586f-8ca0-47c78321bc64, identifier: UE23148
2026-03-28 07:30:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94f7b76f-04a9-586f-8ca0-47c78321bc64 with identifier: UE23148
2026-03-28 07:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:30:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-28 07:30:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:30:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94f7b76f-04a9-586f-8ca0-47c78321bc64 with identifier: UE23148
2026-03-28 07:30:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94f7b76f-04a9-586f-8ca0-47c78321bc64 with identifier: UE23148 to the API
2026-03-28 07:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:34:04Z',
'fuel_type': 'petrol',
'id': '94f7b76f-04a9-586f-8ca0-47c78321bc64',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE23148',
'listing': 'auction',
'make': 'Seat',
'model': 'Mii',
'odometer': 147585,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-06',
'seller_name': None,
'title': 'Seat Mii 1.0 Reference Viva',
'transmission': 'manual',
'trim': 'Reference Viva',
'year': 2012}
2026-03-28 07:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE23148%27 HTTP/1.1" 200 None
2026-03-28 07:30:28 [auto1.de] INFO: Saving data for UE23148: {'auction_closing_time': 1774884844.0, 'created_time': 1773340610.380669, 'last_price_update_time': 1774683028.452077}
2026-03-28 07:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE23148') HTTP/1.1" 204 0
2026-03-28 07:30:28 [auto1.de] INFO: Found listing with ID: MR80797
2026-03-28 07:30:28 [auto1.de] INFO: Found listing with ID: DW63947
2026-03-28 07:30:28 [auto1.de] INFO: Found listing with ID: JG09776
2026-03-28 07:30:28 [auto1.de] INFO: Found listing with ID: KN89851
2026-03-28 07:30:28 [auto1.de] INFO: Found listing with ID: ZS91776
2026-03-28 07:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS91776%27 HTTP/1.1" 200 None
2026-03-28 07:30:28 [auto1.de] INFO: Scrape type for ZS91776: 2
2026-03-28 07:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 899911fb-c83e-509a-9d54-68363a7de170 with identifier: ZS91776
2026-03-28 07:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 899911fb-c83e-509a-9d54-68363a7de170 with scrape type 2
2026-03-28 07:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 899911fb-c83e-509a-9d54-68363a7de170 with scrape type 2
2026-03-28 07:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 899911fb-c83e-509a-9d54-68363a7de170, identifier: ZS91776
2026-03-28 07:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 899911fb-c83e-509a-9d54-68363a7de170 with identifier: ZS91776
2026-03-28 07:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:30:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 07:30:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 899911fb-c83e-509a-9d54-68363a7de170 with identifier: ZS91776
2026-03-28 07:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 899911fb-c83e-509a-9d54-68363a7de170 with identifier: ZS91776 to the API
2026-03-28 07:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:37:00Z',
'fuel_type': 'petrol',
'id': '899911fb-c83e-509a-9d54-68363a7de170',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS91776',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 94546,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-25',
'seller_name': None,
'title': 'Opel Corsa 1.6 Turbo OPC',
'transmission': 'manual',
'trim': 'OPC',
'year': 2010}
2026-03-28 07:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS91776%27 HTTP/1.1" 200 None
2026-03-28 07:30:29 [auto1.de] INFO: Saving data for ZS91776: {'auction_closing_time': 1774885020.0, 'created_time': 1773467171.650569, 'last_price_update_time': 1774683029.278612}
2026-03-28 07:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS91776') HTTP/1.1" 204 0
2026-03-28 07:30:29 [auto1.de] INFO: Found listing with ID: VX64192
2026-03-28 07:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX64192%27 HTTP/1.1" 200 None
2026-03-28 07:30:29 [auto1.de] INFO: Scrape type for VX64192: 2
2026-03-28 07:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5805ee99-583c-596a-a675-190db41ed1b1 with identifier: VX64192
2026-03-28 07:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5805ee99-583c-596a-a675-190db41ed1b1 with scrape type 2
2026-03-28 07:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5805ee99-583c-596a-a675-190db41ed1b1 with scrape type 2
2026-03-28 07:30:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5805ee99-583c-596a-a675-190db41ed1b1, identifier: VX64192
2026-03-28 07:30:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5805ee99-583c-596a-a675-190db41ed1b1 with identifier: VX64192
2026-03-28 07:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:30:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 07:30:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:30:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5805ee99-583c-596a-a675-190db41ed1b1 with identifier: VX64192
2026-03-28 07:30:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5805ee99-583c-596a-a675-190db41ed1b1 with identifier: VX64192 to the API
2026-03-28 07:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:19:57Z',
'fuel_type': 'diesel',
'id': '5805ee99-583c-596a-a675-190db41ed1b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX64192',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 153076,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-09',
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2019}
2026-03-28 07:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX64192%27 HTTP/1.1" 200 None
2026-03-28 07:30:29 [auto1.de] INFO: Saving data for VX64192: {'auction_closing_time': 1774883997.0, 'created_time': 1774118886.855884, 'last_price_update_time': 1774683029.998973}
2026-03-28 07:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX64192') HTTP/1.1" 204 0
2026-03-28 07:30:30 [auto1.de] INFO: Found listing with ID: SN59057
2026-03-28 07:30:30 [auto1.de] INFO: Found listing with ID: HN30713
2026-03-28 07:30:30 [auto1.de] INFO: Found listing with ID: RU40516
2026-03-28 07:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU40516%27 HTTP/1.1" 200 None
2026-03-28 07:30:30 [auto1.de] INFO: Scrape type for RU40516: 1
2026-03-28 07:30:30 [auto1.de] INFO: Channel: 24h | Page: 1 | totalHits: 9246 | hits on page: 40
2026-03-28 07:30:30 [auto1.de] INFO: Found listing with ID: HX26034
2026-03-28 07:30:30 [auto1.de] INFO: Found listing with ID: JM84539
2026-03-28 07:30:30 [auto1.de] INFO: Found listing with ID: ED17592
2026-03-28 07:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED17592%27 HTTP/1.1" 200 None
2026-03-28 07:30:30 [auto1.de] INFO: Scrape type for ED17592: 2
2026-03-28 07:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac4f785e-414a-5783-bbc9-b6e608012840 with identifier: ED17592
2026-03-28 07:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac4f785e-414a-5783-bbc9-b6e608012840 with scrape type 2
2026-03-28 07:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac4f785e-414a-5783-bbc9-b6e608012840 with scrape type 2
2026-03-28 07:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac4f785e-414a-5783-bbc9-b6e608012840, identifier: ED17592
2026-03-28 07:30:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac4f785e-414a-5783-bbc9-b6e608012840 with identifier: ED17592
2026-03-28 07:30:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac4f785e-414a-5783-bbc9-b6e608012840 with identifier: ED17592
2026-03-28 07:30:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac4f785e-414a-5783-bbc9-b6e608012840 with identifier: ED17592 to the API
2026-03-28 07:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:57:51Z',
'fuel_type': 'petrol',
'id': 'ac4f785e-414a-5783-bbc9-b6e608012840',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED17592',
'listing': 'auction',
'make': 'Toyota',
'model': 'Corolla Verso',
'odometer': 90377,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-02-27',
'seller_name': None,
'title': 'Toyota Corolla Verso 1.8 Sol',
'transmission': 'automatic',
'trim': 'Sol',
'year': 2003}
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED17592%27 HTTP/1.1" 200 None
2026-03-28 07:30:31 [auto1.de] INFO: Saving data for ED17592: {'auction_closing_time': 1774886271.0, 'created_time': 1773467238.933615, 'last_price_update_time': 1774683031.521034}
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED17592') HTTP/1.1" 204 0
2026-03-28 07:30:31 [auto1.de] INFO: Found listing with ID: WJ88731
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ88731%27 HTTP/1.1" 200 None
2026-03-28 07:30:31 [auto1.de] INFO: Scrape type for WJ88731: 0
2026-03-28 07:30:31 [auto1.de] INFO: Found listing with ID: GY05092
2026-03-28 07:30:31 [auto1.de] INFO: Found listing with ID: NH74932
2026-03-28 07:30:31 [auto1.de] INFO: Found listing with ID: WA60872
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA60872%27 HTTP/1.1" 200 None
2026-03-28 07:30:31 [auto1.de] INFO: Scrape type for WA60872: 0
2026-03-28 07:30:31 [auto1.de] INFO: Found listing with ID: PC86018
2026-03-28 07:30:31 [auto1.de] INFO: Found listing with ID: EE70645
2026-03-28 07:30:31 [auto1.de] INFO: Found listing with ID: RJ17594
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ17594%27 HTTP/1.1" 200 None
2026-03-28 07:30:31 [auto1.de] INFO: Scrape type for RJ17594: 0
2026-03-28 07:30:31 [auto1.de] INFO: Found listing with ID: WC98530
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC98530%27 HTTP/1.1" 200 None
2026-03-28 07:30:31 [auto1.de] INFO: Scrape type for WC98530: 0
2026-03-28 07:30:31 [auto1.de] INFO: Found listing with ID: ET93890
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET93890%27 HTTP/1.1" 200 None
2026-03-28 07:30:31 [auto1.de] INFO: Scrape type for ET93890: 0
2026-03-28 07:30:31 [auto1.de] INFO: Found listing with ID: DV01854
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV01854%27 HTTP/1.1" 200 None
2026-03-28 07:30:31 [auto1.de] INFO: Scrape type for DV01854: 0
2026-03-28 07:30:31 [auto1.de] INFO: Found listing with ID: GV87257
2026-03-28 07:30:31 [auto1.de] INFO: Found listing with ID: UE23148
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE23148%27 HTTP/1.1" 200 None
2026-03-28 07:30:31 [auto1.de] INFO: Scrape type for UE23148: 0
2026-03-28 07:30:31 [auto1.de] INFO: Found listing with ID: MR80797
2026-03-28 07:30:31 [auto1.de] INFO: Found listing with ID: DW63947
2026-03-28 07:30:31 [auto1.de] INFO: Found listing with ID: JG09776
2026-03-28 07:30:31 [auto1.de] INFO: Found listing with ID: KN89851
2026-03-28 07:30:31 [auto1.de] INFO: Found listing with ID: ZS91776
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS91776%27 HTTP/1.1" 200 None
2026-03-28 07:30:31 [auto1.de] INFO: Scrape type for ZS91776: 0
2026-03-28 07:30:31 [auto1.de] INFO: Found listing with ID: VX64192
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX64192%27 HTTP/1.1" 200 None
2026-03-28 07:30:31 [auto1.de] INFO: Scrape type for VX64192: 0
2026-03-28 07:30:31 [auto1.de] INFO: Found listing with ID: SN59057
2026-03-28 07:30:31 [auto1.de] INFO: Found listing with ID: HN30713
2026-03-28 07:30:31 [auto1.de] INFO: Found listing with ID: RU40516
2026-03-28 07:30:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:30:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:30:31 [auto1.de] INFO: Found listing with ID: FX10664
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX10664%27 HTTP/1.1" 200 None
2026-03-28 07:30:31 [auto1.de] INFO: Scrape type for FX10664: 2
2026-03-28 07:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b6aace6-73a2-5f25-abf9-7cd08a6826b1 with identifier: FX10664
2026-03-28 07:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b6aace6-73a2-5f25-abf9-7cd08a6826b1 with scrape type 2
2026-03-28 07:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b6aace6-73a2-5f25-abf9-7cd08a6826b1 with scrape type 2
2026-03-28 07:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b6aace6-73a2-5f25-abf9-7cd08a6826b1, identifier: FX10664
2026-03-28 07:30:32 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/RU40516/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 07:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b6aace6-73a2-5f25-abf9-7cd08a6826b1 with identifier: FX10664
2026-03-28 07:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b6aace6-73a2-5f25-abf9-7cd08a6826b1 with identifier: FX10664
2026-03-28 07:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b6aace6-73a2-5f25-abf9-7cd08a6826b1 with identifier: FX10664 to the API
2026-03-28 07:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:11:26Z',
'fuel_type': 'diesel',
'id': '8b6aace6-73a2-5f25-abf9-7cd08a6826b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX10664',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 173452,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-12',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI quattro Sport selection',
'transmission': 'automatic',
'trim': 'quattro Sport selection',
'year': 2013}
2026-03-28 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX10664%27 HTTP/1.1" 200 None
2026-03-28 07:30:32 [auto1.de] INFO: Saving data for FX10664: {'auction_closing_time': 1774883486.0, 'created_time': 1774118554.546192, 'last_price_update_time': 1774683032.389296}
2026-03-28 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX10664') HTTP/1.1" 204 0
2026-03-28 07:30:32 [auto1.de] INFO: Found listing with ID: HX26034
2026-03-28 07:30:32 [auto1.de] INFO: Found listing with ID: JM84539
2026-03-28 07:30:32 [auto1.de] INFO: Found listing with ID: ED17592
2026-03-28 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED17592%27 HTTP/1.1" 200 None
2026-03-28 07:30:32 [auto1.de] INFO: Scrape type for ED17592: 0
2026-03-28 07:30:32 [auto1.de] INFO: Found listing with ID: FX10664
2026-03-28 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX10664%27 HTTP/1.1" 200 None
2026-03-28 07:30:32 [auto1.de] INFO: Scrape type for FX10664: 0
2026-03-28 07:30:32 [auto1.de] INFO: Found listing with ID: YS85041
2026-03-28 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS85041%27 HTTP/1.1" 200 None
2026-03-28 07:30:32 [auto1.de] INFO: Scrape type for YS85041: 2
2026-03-28 07:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc741722-e624-5e40-a631-61295802977a with identifier: YS85041
2026-03-28 07:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc741722-e624-5e40-a631-61295802977a with scrape type 2
2026-03-28 07:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc741722-e624-5e40-a631-61295802977a with scrape type 2
2026-03-28 07:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc741722-e624-5e40-a631-61295802977a, identifier: YS85041
2026-03-28 07:30:32 [auto1.de] INFO: Found listing with ID: YS85041
2026-03-28 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS85041%27 HTTP/1.1" 200 None
2026-03-28 07:30:32 [auto1.de] INFO: Scrape type for YS85041: 2
2026-03-28 07:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc741722-e624-5e40-a631-61295802977a with scrape type 2
2026-03-28 07:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc741722-e624-5e40-a631-61295802977a with scrape type 2
2026-03-28 07:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc741722-e624-5e40-a631-61295802977a, identifier: YS85041
2026-03-28 07:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc741722-e624-5e40-a631-61295802977a with identifier: YS85041
2026-03-28 07:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc741722-e624-5e40-a631-61295802977a with identifier: YS85041
2026-03-28 07:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc741722-e624-5e40-a631-61295802977a with identifier: YS85041 to the API
2026-03-28 07:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:13:47Z',
'fuel_type': 'petrol',
'id': 'cc741722-e624-5e40-a631-61295802977a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS85041',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 151746,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-29',
'seller_name': None,
'title': 'Renault Twingo 1.2 YAHOO!',
'transmission': 'manual',
'trim': 'YAHOO!',
'year': 2011}
2026-03-28 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS85041%27 HTTP/1.1" 200 None
2026-03-28 07:30:33 [auto1.de] INFO: Saving data for YS85041: {'auction_closing_time': 1774883627.0, 'created_time': 1773946040.302004, 'last_price_update_time': 1774683033.09854}
2026-03-28 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS85041') HTTP/1.1" 204 0
2026-03-28 07:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc741722-e624-5e40-a631-61295802977a with identifier: YS85041
2026-03-28 07:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc741722-e624-5e40-a631-61295802977a with identifier: YS85041
2026-03-28 07:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc741722-e624-5e40-a631-61295802977a with identifier: YS85041 to the API
2026-03-28 07:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:13:47Z',
'fuel_type': 'petrol',
'id': 'cc741722-e624-5e40-a631-61295802977a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS85041',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 151746,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-29',
'seller_name': None,
'title': 'Renault Twingo 1.2 YAHOO!',
'transmission': 'manual',
'trim': 'YAHOO!',
'year': 2011}
2026-03-28 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS85041%27 HTTP/1.1" 200 None
2026-03-28 07:30:33 [auto1.de] INFO: Saving data for YS85041: {'auction_closing_time': 1774883627.0, 'created_time': 1773946040.302004, 'last_price_update_time': 1774683033.370961}
2026-03-28 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS85041') HTTP/1.1" 204 0
2026-03-28 07:30:33 [auto1.de] INFO: Found listing with ID: SA72016
2026-03-28 07:30:33 [auto1.de] INFO: Found listing with ID: WG54603
2026-03-28 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG54603%27 HTTP/1.1" 200 None
2026-03-28 07:30:33 [auto1.de] INFO: Scrape type for WG54603: 2
2026-03-28 07:30:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7dd9e17-be31-5b6b-a31a-e85064d8f3dd with identifier: WG54603
2026-03-28 07:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7dd9e17-be31-5b6b-a31a-e85064d8f3dd with scrape type 2
2026-03-28 07:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7dd9e17-be31-5b6b-a31a-e85064d8f3dd with scrape type 2
2026-03-28 07:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7dd9e17-be31-5b6b-a31a-e85064d8f3dd, identifier: WG54603
2026-03-28 07:30:33 [auto1.de] INFO: Found listing with ID: SA72016
2026-03-28 07:30:33 [auto1.de] INFO: Found listing with ID: WG54603
2026-03-28 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG54603%27 HTTP/1.1" 200 None
2026-03-28 07:30:33 [auto1.de] INFO: Scrape type for WG54603: 2
2026-03-28 07:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7dd9e17-be31-5b6b-a31a-e85064d8f3dd with scrape type 2
2026-03-28 07:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7dd9e17-be31-5b6b-a31a-e85064d8f3dd with scrape type 2
2026-03-28 07:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7dd9e17-be31-5b6b-a31a-e85064d8f3dd, identifier: WG54603
2026-03-28 07:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7dd9e17-be31-5b6b-a31a-e85064d8f3dd with identifier: WG54603
2026-03-28 07:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7dd9e17-be31-5b6b-a31a-e85064d8f3dd with identifier: WG54603
2026-03-28 07:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7dd9e17-be31-5b6b-a31a-e85064d8f3dd with identifier: WG54603 to the API
2026-03-28 07:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:45:45Z',
'fuel_type': 'petrol',
'id': 'd7dd9e17-be31-5b6b-a31a-e85064d8f3dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG54603',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 168513,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-25',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2009}
2026-03-28 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG54603%27 HTTP/1.1" 200 None
2026-03-28 07:30:33 [auto1.de] INFO: Saving data for WG54603: {'auction_closing_time': 1774885545.0, 'created_time': 1773945281.786207, 'last_price_update_time': 1774683033.978756}
2026-03-28 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG54603') HTTP/1.1" 204 0
2026-03-28 07:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7dd9e17-be31-5b6b-a31a-e85064d8f3dd with identifier: WG54603
2026-03-28 07:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7dd9e17-be31-5b6b-a31a-e85064d8f3dd with identifier: WG54603
2026-03-28 07:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7dd9e17-be31-5b6b-a31a-e85064d8f3dd with identifier: WG54603 to the API
2026-03-28 07:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:45:45Z',
'fuel_type': 'petrol',
'id': 'd7dd9e17-be31-5b6b-a31a-e85064d8f3dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG54603',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 168513,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-25',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2009}
2026-03-28 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG54603%27 HTTP/1.1" 200 None
2026-03-28 07:30:34 [auto1.de] INFO: Saving data for WG54603: {'auction_closing_time': 1774885545.0, 'created_time': 1773945281.786207, 'last_price_update_time': 1774683034.272429}
2026-03-28 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG54603') HTTP/1.1" 204 0
2026-03-28 07:30:34 [auto1.de] INFO: Found listing with ID: VV82390
2026-03-28 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV82390%27 HTTP/1.1" 200 None
2026-03-28 07:30:34 [auto1.de] INFO: Scrape type for VV82390: 2
2026-03-28 07:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7be466fb-b23f-5722-b01b-1945c2a5ab78 with identifier: VV82390
2026-03-28 07:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7be466fb-b23f-5722-b01b-1945c2a5ab78 with scrape type 2
2026-03-28 07:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7be466fb-b23f-5722-b01b-1945c2a5ab78 with scrape type 2
2026-03-28 07:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7be466fb-b23f-5722-b01b-1945c2a5ab78, identifier: VV82390
2026-03-28 07:30:34 [auto1.de] INFO: Found listing with ID: VV82390
2026-03-28 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV82390%27 HTTP/1.1" 200 None
2026-03-28 07:30:34 [auto1.de] INFO: Scrape type for VV82390: 2
2026-03-28 07:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7be466fb-b23f-5722-b01b-1945c2a5ab78 with scrape type 2
2026-03-28 07:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7be466fb-b23f-5722-b01b-1945c2a5ab78 with scrape type 2
2026-03-28 07:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7be466fb-b23f-5722-b01b-1945c2a5ab78, identifier: VV82390
2026-03-28 07:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7be466fb-b23f-5722-b01b-1945c2a5ab78 with identifier: VV82390
2026-03-28 07:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7be466fb-b23f-5722-b01b-1945c2a5ab78 with identifier: VV82390
2026-03-28 07:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7be466fb-b23f-5722-b01b-1945c2a5ab78 with identifier: VV82390 to the API
2026-03-28 07:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 231,
'expiration_date': '2026-03-30T15:25:59Z',
'fuel_type': 'diesel',
'id': '7be466fb-b23f-5722-b01b-1945c2a5ab78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV82390',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 152220,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-13',
'seller_name': None,
'title': 'Audi A4 45 TDI quattro advanced',
'transmission': 'automatic',
'trim': 'quattro advanced',
'year': 2020}
2026-03-28 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV82390%27 HTTP/1.1" 200 None
2026-03-28 07:30:34 [auto1.de] INFO: Saving data for VV82390: {'auction_closing_time': 1774884359.0, 'created_time': 1774349641.18222, 'last_price_update_time': 1774683034.869388}
2026-03-28 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV82390') HTTP/1.1" 204 0
2026-03-28 07:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7be466fb-b23f-5722-b01b-1945c2a5ab78 with identifier: VV82390
2026-03-28 07:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7be466fb-b23f-5722-b01b-1945c2a5ab78 with identifier: VV82390
2026-03-28 07:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7be466fb-b23f-5722-b01b-1945c2a5ab78 with identifier: VV82390 to the API
2026-03-28 07:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 231,
'expiration_date': '2026-03-30T15:25:59Z',
'fuel_type': 'diesel',
'id': '7be466fb-b23f-5722-b01b-1945c2a5ab78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV82390',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 152220,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-13',
'seller_name': None,
'title': 'Audi A4 45 TDI quattro advanced',
'transmission': 'automatic',
'trim': 'quattro advanced',
'year': 2020}
2026-03-28 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV82390%27 HTTP/1.1" 200 None
2026-03-28 07:30:35 [auto1.de] INFO: Saving data for VV82390: {'auction_closing_time': 1774884359.0, 'created_time': 1774349641.18222, 'last_price_update_time': 1774683035.231667}
2026-03-28 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV82390') HTTP/1.1" 204 0
2026-03-28 07:30:35 [auto1.de] INFO: Found listing with ID: SK64465
2026-03-28 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK64465%27 HTTP/1.1" 200 None
2026-03-28 07:30:35 [auto1.de] INFO: Scrape type for SK64465: 0
2026-03-28 07:30:35 [auto1.de] INFO: Found listing with ID: GY99851
2026-03-28 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY99851%27 HTTP/1.1" 200 None
2026-03-28 07:30:35 [auto1.de] INFO: Scrape type for GY99851: 2
2026-03-28 07:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ee98b40-6325-5042-bb22-26170b1a5d83 with identifier: GY99851
2026-03-28 07:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ee98b40-6325-5042-bb22-26170b1a5d83 with scrape type 2
2026-03-28 07:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ee98b40-6325-5042-bb22-26170b1a5d83 with scrape type 2
2026-03-28 07:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ee98b40-6325-5042-bb22-26170b1a5d83, identifier: GY99851
2026-03-28 07:30:35 [auto1.de] INFO: Found listing with ID: SK64465
2026-03-28 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK64465%27 HTTP/1.1" 200 None
2026-03-28 07:30:35 [auto1.de] INFO: Scrape type for SK64465: 0
2026-03-28 07:30:35 [auto1.de] INFO: Found listing with ID: GY99851
2026-03-28 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY99851%27 HTTP/1.1" 200 None
2026-03-28 07:30:35 [auto1.de] INFO: Scrape type for GY99851: 2
2026-03-28 07:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ee98b40-6325-5042-bb22-26170b1a5d83 with scrape type 2
2026-03-28 07:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ee98b40-6325-5042-bb22-26170b1a5d83 with scrape type 2
2026-03-28 07:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ee98b40-6325-5042-bb22-26170b1a5d83, identifier: GY99851
2026-03-28 07:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ee98b40-6325-5042-bb22-26170b1a5d83 with identifier: GY99851
2026-03-28 07:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ee98b40-6325-5042-bb22-26170b1a5d83 with identifier: GY99851
2026-03-28 07:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ee98b40-6325-5042-bb22-26170b1a5d83 with identifier: GY99851 to the API
2026-03-28 07:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:57:33Z',
'fuel_type': 'diesel',
'id': '5ee98b40-6325-5042-bb22-26170b1a5d83',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY99851',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 140000,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-06',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2016}
2026-03-28 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY99851%27 HTTP/1.1" 200 None
2026-03-28 07:30:35 [auto1.de] INFO: Saving data for GY99851: {'auction_closing_time': 1774886253.0, 'created_time': 1774293714.839555, 'last_price_update_time': 1774683035.792795}
2026-03-28 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY99851') HTTP/1.1" 204 0
2026-03-28 07:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ee98b40-6325-5042-bb22-26170b1a5d83 with identifier: GY99851
2026-03-28 07:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ee98b40-6325-5042-bb22-26170b1a5d83 with identifier: GY99851
2026-03-28 07:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ee98b40-6325-5042-bb22-26170b1a5d83 with identifier: GY99851 to the API
2026-03-28 07:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:57:33Z',
'fuel_type': 'diesel',
'id': '5ee98b40-6325-5042-bb22-26170b1a5d83',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY99851',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 140000,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-06',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2016}
2026-03-28 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY99851%27 HTTP/1.1" 200 None
2026-03-28 07:30:36 [auto1.de] INFO: Saving data for GY99851: {'auction_closing_time': 1774886253.0, 'created_time': 1774293714.839555, 'last_price_update_time': 1774683036.083494}
2026-03-28 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY99851') HTTP/1.1" 204 0
2026-03-28 07:30:36 [auto1.de] INFO: Found listing with ID: KG73349
2026-03-28 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG73349%27 HTTP/1.1" 200 None
2026-03-28 07:30:36 [auto1.de] INFO: Scrape type for KG73349: 2
2026-03-28 07:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f95168f-3d5d-5947-b30a-0c1e9baf6d52 with identifier: KG73349
2026-03-28 07:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f95168f-3d5d-5947-b30a-0c1e9baf6d52 with scrape type 2
2026-03-28 07:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f95168f-3d5d-5947-b30a-0c1e9baf6d52 with scrape type 2
2026-03-28 07:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f95168f-3d5d-5947-b30a-0c1e9baf6d52, identifier: KG73349
2026-03-28 07:30:36 [auto1.de] INFO: Found listing with ID: KG73349
2026-03-28 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG73349%27 HTTP/1.1" 200 None
2026-03-28 07:30:36 [auto1.de] INFO: Scrape type for KG73349: 2
2026-03-28 07:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f95168f-3d5d-5947-b30a-0c1e9baf6d52 with scrape type 2
2026-03-28 07:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f95168f-3d5d-5947-b30a-0c1e9baf6d52 with scrape type 2
2026-03-28 07:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f95168f-3d5d-5947-b30a-0c1e9baf6d52, identifier: KG73349
2026-03-28 07:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f95168f-3d5d-5947-b30a-0c1e9baf6d52 with identifier: KG73349
2026-03-28 07:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f95168f-3d5d-5947-b30a-0c1e9baf6d52 with identifier: KG73349
2026-03-28 07:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f95168f-3d5d-5947-b30a-0c1e9baf6d52 with identifier: KG73349 to the API
2026-03-28 07:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:10:31Z',
'fuel_type': 'petrol',
'id': '3f95168f-3d5d-5947-b30a-0c1e9baf6d52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG73349',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 135637,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-24',
'seller_name': None,
'title': 'Skoda Octavia 1.4 TSI Edition',
'transmission': 'automatic',
'trim': 'Edition',
'year': 2016}
2026-03-28 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG73349%27 HTTP/1.1" 200 None
2026-03-28 07:30:36 [auto1.de] INFO: Saving data for KG73349: {'auction_closing_time': 1774883431.0, 'created_time': 1773467475.85263, 'last_price_update_time': 1774683036.632433}
2026-03-28 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG73349') HTTP/1.1" 204 0
2026-03-28 07:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f95168f-3d5d-5947-b30a-0c1e9baf6d52 with identifier: KG73349
2026-03-28 07:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f95168f-3d5d-5947-b30a-0c1e9baf6d52 with identifier: KG73349
2026-03-28 07:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f95168f-3d5d-5947-b30a-0c1e9baf6d52 with identifier: KG73349 to the API
2026-03-28 07:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:10:31Z',
'fuel_type': 'petrol',
'id': '3f95168f-3d5d-5947-b30a-0c1e9baf6d52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG73349',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 135637,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-24',
'seller_name': None,
'title': 'Skoda Octavia 1.4 TSI Edition',
'transmission': 'automatic',
'trim': 'Edition',
'year': 2016}
2026-03-28 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG73349%27 HTTP/1.1" 200 None
2026-03-28 07:30:36 [auto1.de] INFO: Saving data for KG73349: {'auction_closing_time': 1774883431.0, 'created_time': 1773467475.85263, 'last_price_update_time': 1774683036.910339}
2026-03-28 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG73349') HTTP/1.1" 204 0
2026-03-28 07:30:36 [auto1.de] INFO: Found listing with ID: NR46432
2026-03-28 07:30:36 [auto1.de] INFO: Found listing with ID: GD21382
2026-03-28 07:30:36 [auto1.de] INFO: Found listing with ID: GX76510
2026-03-28 07:30:36 [auto1.de] INFO: Found listing with ID: DT67052
2026-03-28 07:30:36 [auto1.de] INFO: Found listing with ID: ZZ82496
2026-03-28 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ82496%27 HTTP/1.1" 200 None
2026-03-28 07:30:36 [auto1.de] INFO: Scrape type for ZZ82496: 2
2026-03-28 07:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8bcc120-49d0-5a50-84a7-daa7d1a94547 with identifier: ZZ82496
2026-03-28 07:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8bcc120-49d0-5a50-84a7-daa7d1a94547 with scrape type 2
2026-03-28 07:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8bcc120-49d0-5a50-84a7-daa7d1a94547 with scrape type 2
2026-03-28 07:30:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8bcc120-49d0-5a50-84a7-daa7d1a94547, identifier: ZZ82496
2026-03-28 07:30:37 [auto1.de] INFO: Found listing with ID: NR46432
2026-03-28 07:30:37 [auto1.de] INFO: Found listing with ID: GD21382
2026-03-28 07:30:37 [auto1.de] INFO: Found listing with ID: GX76510
2026-03-28 07:30:37 [auto1.de] INFO: Found listing with ID: DT67052
2026-03-28 07:30:37 [auto1.de] INFO: Found listing with ID: ZZ82496
2026-03-28 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ82496%27 HTTP/1.1" 200 None
2026-03-28 07:30:37 [auto1.de] INFO: Scrape type for ZZ82496: 2
2026-03-28 07:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8bcc120-49d0-5a50-84a7-daa7d1a94547 with scrape type 2
2026-03-28 07:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8bcc120-49d0-5a50-84a7-daa7d1a94547 with scrape type 2
2026-03-28 07:30:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8bcc120-49d0-5a50-84a7-daa7d1a94547, identifier: ZZ82496
2026-03-28 07:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8bcc120-49d0-5a50-84a7-daa7d1a94547 with identifier: ZZ82496
2026-03-28 07:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8bcc120-49d0-5a50-84a7-daa7d1a94547 with identifier: ZZ82496
2026-03-28 07:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8bcc120-49d0-5a50-84a7-daa7d1a94547 with identifier: ZZ82496 to the API
2026-03-28 07:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 585,
'expiration_date': '2026-03-30T15:09:33Z',
'fuel_type': 'petrol',
'id': 'b8bcc120-49d0-5a50-84a7-daa7d1a94547',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ82496',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 139095,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-18',
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 63 AMG S 4Matic',
'transmission': 'automatic',
'trim': 'S 4Matic',
'year': 2016}
2026-03-28 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ82496%27 HTTP/1.1" 200 None
2026-03-28 07:30:37 [auto1.de] INFO: Saving data for ZZ82496: {'auction_closing_time': 1774883373.0, 'created_time': 1774034465.270593, 'last_price_update_time': 1774683037.482468}
2026-03-28 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ82496') HTTP/1.1" 204 0
2026-03-28 07:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8bcc120-49d0-5a50-84a7-daa7d1a94547 with identifier: ZZ82496
2026-03-28 07:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8bcc120-49d0-5a50-84a7-daa7d1a94547 with identifier: ZZ82496
2026-03-28 07:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8bcc120-49d0-5a50-84a7-daa7d1a94547 with identifier: ZZ82496 to the API
2026-03-28 07:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 585,
'expiration_date': '2026-03-30T15:09:33Z',
'fuel_type': 'petrol',
'id': 'b8bcc120-49d0-5a50-84a7-daa7d1a94547',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ82496',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 139095,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-18',
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 63 AMG S 4Matic',
'transmission': 'automatic',
'trim': 'S 4Matic',
'year': 2016}
2026-03-28 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ82496%27 HTTP/1.1" 200 None
2026-03-28 07:30:37 [auto1.de] INFO: Saving data for ZZ82496: {'auction_closing_time': 1774883373.0, 'created_time': 1774034465.270593, 'last_price_update_time': 1774683037.867256}
2026-03-28 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ82496') HTTP/1.1" 204 0
2026-03-28 07:30:37 [auto1.de] INFO: Found listing with ID: MA81744
2026-03-28 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81744%27 HTTP/1.1" 200 None
2026-03-28 07:30:37 [auto1.de] INFO: Scrape type for MA81744: 2
2026-03-28 07:30:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c with identifier: MA81744
2026-03-28 07:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c with scrape type 2
2026-03-28 07:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c with scrape type 2
2026-03-28 07:30:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c, identifier: MA81744
2026-03-28 07:30:37 [auto1.de] INFO: Found listing with ID: MA81744
2026-03-28 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81744%27 HTTP/1.1" 200 None
2026-03-28 07:30:38 [auto1.de] INFO: Scrape type for MA81744: 2
2026-03-28 07:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c with scrape type 2
2026-03-28 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c with scrape type 2
2026-03-28 07:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c, identifier: MA81744
2026-03-28 07:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c with identifier: MA81744
2026-03-28 07:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:30:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 07:30:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c with identifier: MA81744
2026-03-28 07:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c with identifier: MA81744 to the API
2026-03-28 07:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 367,
'expiration_date': '2026-03-30T15:13:26Z',
'fuel_type': 'hybrid',
'id': '9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA81744',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 177312,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-02',
'seller_name': None,
'title': 'Audi A6 55 TFSIe quattro sport',
'transmission': 'automatic',
'trim': 'quattro sport',
'year': 2021}
2026-03-28 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81744%27 HTTP/1.1" 200 None
2026-03-28 07:30:38 [auto1.de] INFO: Saving data for MA81744: {'auction_closing_time': 1774883606.0, 'created_time': 1773775383.337339, 'last_price_update_time': 1774683038.559904}
2026-03-28 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA81744') HTTP/1.1" 204 0
2026-03-28 07:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c with identifier: MA81744
2026-03-28 07:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c with identifier: MA81744
2026-03-28 07:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c with identifier: MA81744 to the API
2026-03-28 07:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 367,
'expiration_date': '2026-03-30T15:13:26Z',
'fuel_type': 'hybrid',
'id': '9f3ee0c5-1764-5ba5-b7cf-81ddcf8d5f9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA81744',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 177312,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-02',
'seller_name': None,
'title': 'Audi A6 55 TFSIe quattro sport',
'transmission': 'automatic',
'trim': 'quattro sport',
'year': 2021}
2026-03-28 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81744%27 HTTP/1.1" 200 None
2026-03-28 07:30:38 [auto1.de] INFO: Saving data for MA81744: {'auction_closing_time': 1774883606.0, 'created_time': 1773775383.337339, 'last_price_update_time': 1774683038.843476}
2026-03-28 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA81744') HTTP/1.1" 204 0
2026-03-28 07:30:38 [auto1.de] INFO: Found listing with ID: KG50767
2026-03-28 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG50767%27 HTTP/1.1" 200 None
2026-03-28 07:30:38 [auto1.de] INFO: Scrape type for KG50767: 2
2026-03-28 07:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fba9dcc1-4ef9-5a74-bb65-bee726d73a84 with identifier: KG50767
2026-03-28 07:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fba9dcc1-4ef9-5a74-bb65-bee726d73a84 with scrape type 2
2026-03-28 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fba9dcc1-4ef9-5a74-bb65-bee726d73a84 with scrape type 2
2026-03-28 07:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fba9dcc1-4ef9-5a74-bb65-bee726d73a84, identifier: KG50767
2026-03-28 07:30:38 [auto1.de] INFO: Found listing with ID: KG50767
2026-03-28 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG50767%27 HTTP/1.1" 200 None
2026-03-28 07:30:38 [auto1.de] INFO: Scrape type for KG50767: 2
2026-03-28 07:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fba9dcc1-4ef9-5a74-bb65-bee726d73a84 with scrape type 2
2026-03-28 07:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fba9dcc1-4ef9-5a74-bb65-bee726d73a84 with scrape type 2
2026-03-28 07:30:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fba9dcc1-4ef9-5a74-bb65-bee726d73a84, identifier: KG50767
2026-03-28 07:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fba9dcc1-4ef9-5a74-bb65-bee726d73a84 with identifier: KG50767
2026-03-28 07:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fba9dcc1-4ef9-5a74-bb65-bee726d73a84 with identifier: KG50767
2026-03-28 07:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fba9dcc1-4ef9-5a74-bb65-bee726d73a84 with identifier: KG50767 to the API
2026-03-28 07:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:02:15Z',
'fuel_type': 'diesel',
'id': 'fba9dcc1-4ef9-5a74-bb65-bee726d73a84',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG50767',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 167652,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-29',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Selection',
'transmission': 'automatic',
'trim': 'Selection',
'year': 2015}
2026-03-28 07:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG50767%27 HTTP/1.1" 200 None
2026-03-28 07:30:39 [auto1.de] INFO: Saving data for KG50767: {'auction_closing_time': 1774882935.0, 'created_time': 1773468255.451886, 'last_price_update_time': 1774683039.425344}
2026-03-28 07:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG50767') HTTP/1.1" 204 0
2026-03-28 07:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fba9dcc1-4ef9-5a74-bb65-bee726d73a84 with identifier: KG50767
2026-03-28 07:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fba9dcc1-4ef9-5a74-bb65-bee726d73a84 with identifier: KG50767
2026-03-28 07:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fba9dcc1-4ef9-5a74-bb65-bee726d73a84 with identifier: KG50767 to the API
2026-03-28 07:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:02:15Z',
'fuel_type': 'diesel',
'id': 'fba9dcc1-4ef9-5a74-bb65-bee726d73a84',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG50767',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 167652,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-29',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Selection',
'transmission': 'automatic',
'trim': 'Selection',
'year': 2015}
2026-03-28 07:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG50767%27 HTTP/1.1" 200 None
2026-03-28 07:30:39 [auto1.de] INFO: Saving data for KG50767: {'auction_closing_time': 1774882935.0, 'created_time': 1773468255.451886, 'last_price_update_time': 1774683039.711718}
2026-03-28 07:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG50767') HTTP/1.1" 204 0
2026-03-28 07:30:39 [auto1.de] INFO: Found listing with ID: AR70360
2026-03-28 07:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR70360%27 HTTP/1.1" 200 None
2026-03-28 07:30:39 [auto1.de] INFO: Scrape type for AR70360: 2
2026-03-28 07:30:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5 with identifier: AR70360
2026-03-28 07:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5 with scrape type 2
2026-03-28 07:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5 with scrape type 2
2026-03-28 07:30:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5, identifier: AR70360
2026-03-28 07:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:30:39 [auto1.de] INFO: Found listing with ID: AR70360
2026-03-28 07:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR70360%27 HTTP/1.1" 200 None
2026-03-28 07:30:39 [auto1.de] INFO: Scrape type for AR70360: 2
2026-03-28 07:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5 with scrape type 2
2026-03-28 07:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5 with scrape type 2
2026-03-28 07:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5, identifier: AR70360
2026-03-28 07:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5 with identifier: AR70360
2026-03-28 07:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5 with identifier: AR70360
2026-03-28 07:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5 with identifier: AR70360 to the API
2026-03-28 07:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:24:03Z',
'fuel_type': 'diesel',
'id': '2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR70360',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 180598,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-07',
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 2.0 HDi Exclusive',
'transmission': 'automatic',
'trim': 'Exclusive',
'year': 2011}
2026-03-28 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR70360%27 HTTP/1.1" 200 None
2026-03-28 07:30:40 [auto1.de] INFO: Saving data for AR70360: {'auction_closing_time': 1774884243.0, 'created_time': 1774350011.939473, 'last_price_update_time': 1774683040.334538}
2026-03-28 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR70360') HTTP/1.1" 204 0
2026-03-28 07:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5 with identifier: AR70360
2026-03-28 07:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5 with identifier: AR70360
2026-03-28 07:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5 with identifier: AR70360 to the API
2026-03-28 07:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:24:03Z',
'fuel_type': 'diesel',
'id': '2a2301b7-3b2d-59f0-b2d7-0bc820a2a3e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR70360',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 180598,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-07',
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 2.0 HDi Exclusive',
'transmission': 'automatic',
'trim': 'Exclusive',
'year': 2011}
2026-03-28 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR70360%27 HTTP/1.1" 200 None
2026-03-28 07:30:40 [auto1.de] INFO: Saving data for AR70360: {'auction_closing_time': 1774884243.0, 'created_time': 1774350011.939473, 'last_price_update_time': 1774683040.598282}
2026-03-28 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR70360') HTTP/1.1" 204 0
2026-03-28 07:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RU40516/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:30:40 [auto1.de] INFO: Channel: 24h | Page: 2 | totalHits: 9246 | hits on page: 40
2026-03-28 07:30:40 [auto1.de] INFO: Found listing with ID: YX36608
2026-03-28 07:30:40 [auto1.de] INFO: Found listing with ID: XL74124
2026-03-28 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL74124%27 HTTP/1.1" 200 None
2026-03-28 07:30:40 [auto1.de] INFO: Scrape type for XL74124: 2
2026-03-28 07:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 404c4fca-c19b-5890-84ee-eb3638987a80 with identifier: XL74124
2026-03-28 07:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 404c4fca-c19b-5890-84ee-eb3638987a80 with scrape type 2
2026-03-28 07:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 404c4fca-c19b-5890-84ee-eb3638987a80 with scrape type 2
2026-03-28 07:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 404c4fca-c19b-5890-84ee-eb3638987a80, identifier: XL74124
2026-03-28 07:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 404c4fca-c19b-5890-84ee-eb3638987a80 with identifier: XL74124
2026-03-28 07:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 404c4fca-c19b-5890-84ee-eb3638987a80 with identifier: XL74124
2026-03-28 07:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 404c4fca-c19b-5890-84ee-eb3638987a80 with identifier: XL74124 to the API
2026-03-28 07:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:01:16Z',
'fuel_type': 'petrol',
'id': '404c4fca-c19b-5890-84ee-eb3638987a80',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL74124',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 49591,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-26',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT United',
'transmission': 'manual',
'trim': 'United',
'year': 2021}
2026-03-28 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL74124%27 HTTP/1.1" 200 None
2026-03-28 07:30:41 [auto1.de] INFO: Saving data for XL74124: {'auction_closing_time': 1774882876.0, 'created_time': 1773468768.767412, 'last_price_update_time': 1774683041.066827}
2026-03-28 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL74124') HTTP/1.1" 204 0
2026-03-28 07:30:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:30:41 [auto1.de] INFO: Found listing with ID: WX78972
2026-03-28 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX78972%27 HTTP/1.1" 200 None
2026-03-28 07:30:41 [auto1.de] INFO: Scrape type for WX78972: 2
2026-03-28 07:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b960b74-6842-5897-b927-5fc7a7079f3c with identifier: WX78972
2026-03-28 07:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b960b74-6842-5897-b927-5fc7a7079f3c with scrape type 2
2026-03-28 07:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b960b74-6842-5897-b927-5fc7a7079f3c with scrape type 2
2026-03-28 07:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b960b74-6842-5897-b927-5fc7a7079f3c, identifier: WX78972
2026-03-28 07:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b960b74-6842-5897-b927-5fc7a7079f3c with identifier: WX78972
2026-03-28 07:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b960b74-6842-5897-b927-5fc7a7079f3c with identifier: WX78972
2026-03-28 07:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b960b74-6842-5897-b927-5fc7a7079f3c with identifier: WX78972 to the API
2026-03-28 07:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:23:58Z',
'fuel_type': 'diesel',
'id': '9b960b74-6842-5897-b927-5fc7a7079f3c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX78972',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Multivan',
'odometer': 127572,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-23',
'seller_name': None,
'title': 'Volkswagen T5 Multivan 2.0 TDI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2010}
2026-03-28 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX78972%27 HTTP/1.1" 200 None
2026-03-28 07:30:41 [auto1.de] INFO: Saving data for WX78972: {'auction_closing_time': 1774884238.0, 'created_time': 1774089113.821685, 'last_price_update_time': 1774683041.537426}
2026-03-28 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX78972') HTTP/1.1" 204 0
2026-03-28 07:30:41 [auto1.de] INFO: Found listing with ID: TW02363
2026-03-28 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW02363%27 HTTP/1.1" 200 None
2026-03-28 07:30:41 [auto1.de] INFO: Scrape type for TW02363: 2
2026-03-28 07:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b0e6415-259d-5316-bfdc-885b264b1bb2 with identifier: TW02363
2026-03-28 07:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b0e6415-259d-5316-bfdc-885b264b1bb2 with scrape type 2
2026-03-28 07:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b0e6415-259d-5316-bfdc-885b264b1bb2 with scrape type 2
2026-03-28 07:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b0e6415-259d-5316-bfdc-885b264b1bb2, identifier: TW02363
2026-03-28 07:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b0e6415-259d-5316-bfdc-885b264b1bb2 with identifier: TW02363
2026-03-28 07:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:30:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 07:30:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b0e6415-259d-5316-bfdc-885b264b1bb2 with identifier: TW02363
2026-03-28 07:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b0e6415-259d-5316-bfdc-885b264b1bb2 with identifier: TW02363 to the API
2026-03-28 07:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:26:00Z',
'fuel_type': 'diesel',
'id': '6b0e6415-259d-5316-bfdc-885b264b1bb2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW02363',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 180552,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-28',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
'transmission': 'manual',
'trim': 'AMG Line',
'year': 2015}
2026-03-28 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW02363%27 HTTP/1.1" 200 None
2026-03-28 07:30:42 [auto1.de] INFO: Saving data for TW02363: {'auction_closing_time': 1774884360.0, 'created_time': 1773945603.287468, 'last_price_update_time': 1774683042.122769}
2026-03-28 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW02363') HTTP/1.1" 204 0
2026-03-28 07:30:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:30:42 [auto1.de] INFO: Found listing with ID: HR58634
2026-03-28 07:30:42 [auto1.de] INFO: Found listing with ID: LM22131
2026-03-28 07:30:42 [auto1.de] INFO: Found listing with ID: YV43994
2026-03-28 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV43994%27 HTTP/1.1" 200 None
2026-03-28 07:30:42 [auto1.de] INFO: Scrape type for YV43994: 2
2026-03-28 07:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ab434dc-a15f-5a3d-9afd-f0ce2e24630f with identifier: YV43994
2026-03-28 07:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ab434dc-a15f-5a3d-9afd-f0ce2e24630f with scrape type 2
2026-03-28 07:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ab434dc-a15f-5a3d-9afd-f0ce2e24630f with scrape type 2
2026-03-28 07:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ab434dc-a15f-5a3d-9afd-f0ce2e24630f, identifier: YV43994
2026-03-28 07:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ab434dc-a15f-5a3d-9afd-f0ce2e24630f with identifier: YV43994
2026-03-28 07:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ab434dc-a15f-5a3d-9afd-f0ce2e24630f with identifier: YV43994
2026-03-28 07:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ab434dc-a15f-5a3d-9afd-f0ce2e24630f with identifier: YV43994 to the API
2026-03-28 07:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:26:44Z',
'fuel_type': 'diesel',
'id': '6ab434dc-a15f-5a3d-9afd-f0ce2e24630f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV43994',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 202915,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-11',
'seller_name': None,
'title': 'BMW 3er 318d Sport Line',
'transmission': 'manual',
'trim': 'Sport Line',
'year': 2016}
2026-03-28 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV43994%27 HTTP/1.1" 200 None
2026-03-28 07:30:42 [auto1.de] INFO: Saving data for YV43994: {'auction_closing_time': 1774884404.0, 'created_time': 1773984685.528767, 'last_price_update_time': 1774683042.587309}
2026-03-28 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV43994') HTTP/1.1" 204 0
2026-03-28 07:30:42 [auto1.de] INFO: Found listing with ID: HY99539
2026-03-28 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY99539%27 HTTP/1.1" 200 None
2026-03-28 07:30:42 [auto1.de] INFO: Scrape type for HY99539: 2
2026-03-28 07:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb with identifier: HY99539
2026-03-28 07:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb with scrape type 2
2026-03-28 07:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb with scrape type 2
2026-03-28 07:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb, identifier: HY99539
2026-03-28 07:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb with identifier: HY99539
2026-03-28 07:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb with identifier: HY99539
2026-03-28 07:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb with identifier: HY99539 to the API
2026-03-28 07:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:26:15Z',
'fuel_type': 'petrol',
'id': 'f7e86bf3-ea74-53f7-a90c-ebc76e25e8fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY99539',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 131051,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-27',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TSI Sport & Style 4Motion',
'transmission': 'automatic',
'trim': 'Sport & Style 4Motion',
'year': 2009}
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY99539%27 HTTP/1.1" 200 None
2026-03-28 07:30:43 [auto1.de] INFO: Saving data for HY99539: {'auction_closing_time': 1774884375.0, 'created_time': 1774380352.806279, 'last_price_update_time': 1774683043.142091}
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY99539') HTTP/1.1" 204 0
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: UE63664
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: SR82375
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR82375%27 HTTP/1.1" 200 None
2026-03-28 07:30:43 [auto1.de] INFO: Scrape type for SR82375: 0
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: FH90697
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH90697%27 HTTP/1.1" 200 None
2026-03-28 07:30:43 [auto1.de] INFO: Scrape type for FH90697: 0
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: YV38391
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV38391%27 HTTP/1.1" 200 None
2026-03-28 07:30:43 [auto1.de] INFO: Scrape type for YV38391: 0
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: WB33854
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: XE46726
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE46726%27 HTTP/1.1" 200 None
2026-03-28 07:30:43 [auto1.de] INFO: Scrape type for XE46726: 0
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: KG17192
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: MT99965
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT99965%27 HTTP/1.1" 200 None
2026-03-28 07:30:43 [auto1.de] INFO: Scrape type for MT99965: 0
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: AA81624
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA81624%27 HTTP/1.1" 200 None
2026-03-28 07:30:43 [auto1.de] INFO: Scrape type for AA81624: 0
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: NW69156
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW69156%27 HTTP/1.1" 200 None
2026-03-28 07:30:43 [auto1.de] INFO: Scrape type for NW69156: 0
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: NP38259
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP38259%27 HTTP/1.1" 200 None
2026-03-28 07:30:43 [auto1.de] INFO: Scrape type for NP38259: 0
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: UL41666
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL41666%27 HTTP/1.1" 200 None
2026-03-28 07:30:43 [auto1.de] INFO: Scrape type for UL41666: 0
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: GP13767
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: WL17910
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL17910%27 HTTP/1.1" 200 None
2026-03-28 07:30:43 [auto1.de] INFO: Scrape type for WL17910: 0
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: VX83538
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: SG07809
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG07809%27 HTTP/1.1" 200 None
2026-03-28 07:30:43 [auto1.de] INFO: Scrape type for SG07809: 0
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: ZJ20078
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ20078%27 HTTP/1.1" 200 None
2026-03-28 07:30:43 [auto1.de] INFO: Scrape type for ZJ20078: 0
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: AM79611
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: ZY28796
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: AD81240
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: RK52419
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: MM43491
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM43491%27 HTTP/1.1" 200 None
2026-03-28 07:30:43 [auto1.de] INFO: Scrape type for MM43491: 0
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: XT54020
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: YD03846
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD03846%27 HTTP/1.1" 200 None
2026-03-28 07:30:43 [auto1.de] INFO: Scrape type for YD03846: 0
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: NF38330
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF38330%27 HTTP/1.1" 200 None
2026-03-28 07:30:43 [auto1.de] INFO: Scrape type for NF38330: 0
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: TF89419
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF89419%27 HTTP/1.1" 200 None
2026-03-28 07:30:43 [auto1.de] INFO: Scrape type for TF89419: 0
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: UE91712
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE91712%27 HTTP/1.1" 200 None
2026-03-28 07:30:43 [auto1.de] INFO: Scrape type for UE91712: 0
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: AB05570
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB05570%27 HTTP/1.1" 200 None
2026-03-28 07:30:43 [auto1.de] INFO: Scrape type for AB05570: 0
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: WE30814
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: CV42130
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: TV20692
2026-03-28 07:30:43 [auto1.de] INFO: Found listing with ID: BS96565
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS96565%27 HTTP/1.1" 200 None
2026-03-28 07:30:43 [auto1.de] INFO: Scrape type for BS96565: 0
2026-03-28 07:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RU40516> (referer: https://www.auto1.com/v1/car-details-view/RU40516/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 682c8746-35a8-577a-a11a-26bef4f3d65b with identifier: RU40516
2026-03-28 07:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 682c8746-35a8-577a-a11a-26bef4f3d65b with scrape type 1
2026-03-28 07:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 682c8746-35a8-577a-a11a-26bef4f3d65b
2026-03-28 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fef%252F80ef2b17f477d0cd21445eea670e8e3a%252Fpa%252FRU40516_13789fa0be72313e4daef1ce81a2675a.jpg%27 HTTP/1.1" 200 None
2026-03-28 07:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_13789fa0be72313e4daef1ce81a2675a.jpg not downloaded yet
2026-03-28 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fef%252F80ef2b17f477d0cd21445eea670e8e3a%252Fpa%252FRU40516_0aebcfd02865ba1bc8f68f5727f8d8be.jpg%27 HTTP/1.1" 200 None
2026-03-28 07:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_0aebcfd02865ba1bc8f68f5727f8d8be.jpg not downloaded yet
2026-03-28 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fef%252F80ef2b17f477d0cd21445eea670e8e3a%252Fpa%252FRU40516_e4268189e79db2f891db548afaf98899.jpg%27 HTTP/1.1" 200 None
2026-03-28 07:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_e4268189e79db2f891db548afaf98899.jpg not downloaded yet
2026-03-28 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fef%252F80ef2b17f477d0cd21445eea670e8e3a%252Fpa%252FRU40516_a616446ebffca56ce466b293c2cadbf8.jpg%27 HTTP/1.1" 200 None
2026-03-28 07:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_a616446ebffca56ce466b293c2cadbf8.jpg not downloaded yet
2026-03-28 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fef%252F80ef2b17f477d0cd21445eea670e8e3a%252Fpa%252FRU40516_cd5e0a3b7de44fba7163588ded75b470.jpg%27 HTTP/1.1" 200 None
2026-03-28 07:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_cd5e0a3b7de44fba7163588ded75b470.jpg not downloaded yet
2026-03-28 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fef%252F80ef2b17f477d0cd21445eea670e8e3a%252Fpa%252FRU40516_40decbc879a782f0aaefefcbd0569602.jpg%27 HTTP/1.1" 200 None
2026-03-28 07:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_40decbc879a782f0aaefefcbd0569602.jpg not downloaded yet
2026-03-28 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fef%252F80ef2b17f477d0cd21445eea670e8e3a%252Fpa%252FRU40516_9ceb43c17e412219a70d281c6d4fdd6f.jpg%27 HTTP/1.1" 200 None
2026-03-28 07:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_9ceb43c17e412219a70d281c6d4fdd6f.jpg not downloaded yet
2026-03-28 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fef%252F80ef2b17f477d0cd21445eea670e8e3a%252Fpa%252FRU40516_ecbf1dab3f83c66195c185fcec211247.jpg%27 HTTP/1.1" 200 None
2026-03-28 07:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_ecbf1dab3f83c66195c185fcec211247.jpg not downloaded yet
2026-03-28 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fef%252F80ef2b17f477d0cd21445eea670e8e3a%252Fpa%252FRU40516_01d93e2e2560d77562db87f72de48045.jpg%27 HTTP/1.1" 200 None
2026-03-28 07:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_01d93e2e2560d77562db87f72de48045.jpg not downloaded yet
2026-03-28 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fef%252F80ef2b17f477d0cd21445eea670e8e3a%252Fpa%252FRU40516_4a78a310a2cda149236cafa71dedd13b.jpg%27 HTTP/1.1" 200 None
2026-03-28 07:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_4a78a310a2cda149236cafa71dedd13b.jpg not downloaded yet
2026-03-28 07:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_13789fa0be72313e4daef1ce81a2675a.jpg> (referer: https://www.auto1.com/)
2026-03-28 07:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_01d93e2e2560d77562db87f72de48045.jpg> (referer: https://www.auto1.com/)
2026-03-28 07:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_9ceb43c17e412219a70d281c6d4fdd6f.jpg> (referer: https://www.auto1.com/)
2026-03-28 07:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_e4268189e79db2f891db548afaf98899.jpg> (referer: https://www.auto1.com/)
2026-03-28 07:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_a616446ebffca56ce466b293c2cadbf8.jpg> (referer: https://www.auto1.com/)
2026-03-28 07:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_ecbf1dab3f83c66195c185fcec211247.jpg> (referer: https://www.auto1.com/)
2026-03-28 07:30:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 07:30:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 07:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 07:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07fae2f7d0>
2026-03-28 07:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 07:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_682c8746-35a8-577a-a11a-26bef4f3d65b/682c8746-35a8-577a-a11a-26bef4f3d65b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fef%252F80ef2b17f477d0cd21445eea670e8e3a%252Fpa%252FRU40516_13789fa0be72313e4daef1ce81a2675a.jpg') HTTP/1.1" 204 0
2026-03-28 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_13789fa0be72313e4daef1ce81a2675a.jpg saved to cache
2026-03-28 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 682c8746-35a8-577a-a11a-26bef4f3d65b
2026-03-28 07:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_4a78a310a2cda149236cafa71dedd13b.jpg> (referer: https://www.auto1.com/)
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07fae19a50>
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_682c8746-35a8-577a-a11a-26bef4f3d65b/682c8746-35a8-577a-a11a-26bef4f3d65b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fef%252F80ef2b17f477d0cd21445eea670e8e3a%252Fpa%252FRU40516_01d93e2e2560d77562db87f72de48045.jpg') HTTP/1.1" 204 0
2026-03-28 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_01d93e2e2560d77562db87f72de48045.jpg saved to cache
2026-03-28 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 682c8746-35a8-577a-a11a-26bef4f3d65b
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07fae4d610>
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_682c8746-35a8-577a-a11a-26bef4f3d65b/682c8746-35a8-577a-a11a-26bef4f3d65b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fef%252F80ef2b17f477d0cd21445eea670e8e3a%252Fpa%252FRU40516_9ceb43c17e412219a70d281c6d4fdd6f.jpg') HTTP/1.1" 204 0
2026-03-28 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_9ceb43c17e412219a70d281c6d4fdd6f.jpg saved to cache
2026-03-28 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 682c8746-35a8-577a-a11a-26bef4f3d65b
2026-03-28 07:30:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07fa420150>
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_682c8746-35a8-577a-a11a-26bef4f3d65b/682c8746-35a8-577a-a11a-26bef4f3d65b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fef%252F80ef2b17f477d0cd21445eea670e8e3a%252Fpa%252FRU40516_e4268189e79db2f891db548afaf98899.jpg') HTTP/1.1" 204 0
2026-03-28 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_e4268189e79db2f891db548afaf98899.jpg saved to cache
2026-03-28 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 682c8746-35a8-577a-a11a-26bef4f3d65b
2026-03-28 07:30:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07fae97350>
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_682c8746-35a8-577a-a11a-26bef4f3d65b/682c8746-35a8-577a-a11a-26bef4f3d65b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fef%252F80ef2b17f477d0cd21445eea670e8e3a%252Fpa%252FRU40516_a616446ebffca56ce466b293c2cadbf8.jpg') HTTP/1.1" 204 0
2026-03-28 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_a616446ebffca56ce466b293c2cadbf8.jpg saved to cache
2026-03-28 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 682c8746-35a8-577a-a11a-26bef4f3d65b
2026-03-28 07:30:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07fae060d0>
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_682c8746-35a8-577a-a11a-26bef4f3d65b/682c8746-35a8-577a-a11a-26bef4f3d65b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fef%252F80ef2b17f477d0cd21445eea670e8e3a%252Fpa%252FRU40516_ecbf1dab3f83c66195c185fcec211247.jpg') HTTP/1.1" 204 0
2026-03-28 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_ecbf1dab3f83c66195c185fcec211247.jpg saved to cache
2026-03-28 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 682c8746-35a8-577a-a11a-26bef4f3d65b
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07fad5e610>
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_682c8746-35a8-577a-a11a-26bef4f3d65b/682c8746-35a8-577a-a11a-26bef4f3d65b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fef%252F80ef2b17f477d0cd21445eea670e8e3a%252Fpa%252FRU40516_4a78a310a2cda149236cafa71dedd13b.jpg') HTTP/1.1" 204 0
2026-03-28 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_4a78a310a2cda149236cafa71dedd13b.jpg saved to cache
2026-03-28 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 682c8746-35a8-577a-a11a-26bef4f3d65b
2026-03-28 07:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_40decbc879a782f0aaefefcbd0569602.jpg> (referer: https://www.auto1.com/)
2026-03-28 07:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_cd5e0a3b7de44fba7163588ded75b470.jpg> (referer: https://www.auto1.com/)
2026-03-28 07:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_0aebcfd02865ba1bc8f68f5727f8d8be.jpg> (referer: https://www.auto1.com/)
2026-03-28 07:30:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07fad5d890>
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_682c8746-35a8-577a-a11a-26bef4f3d65b/682c8746-35a8-577a-a11a-26bef4f3d65b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fef%252F80ef2b17f477d0cd21445eea670e8e3a%252Fpa%252FRU40516_40decbc879a782f0aaefefcbd0569602.jpg') HTTP/1.1" 204 0
2026-03-28 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_40decbc879a782f0aaefefcbd0569602.jpg saved to cache
2026-03-28 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 682c8746-35a8-577a-a11a-26bef4f3d65b
2026-03-28 07:30:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07faef1f50>
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_682c8746-35a8-577a-a11a-26bef4f3d65b/682c8746-35a8-577a-a11a-26bef4f3d65b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fef%252F80ef2b17f477d0cd21445eea670e8e3a%252Fpa%252FRU40516_cd5e0a3b7de44fba7163588ded75b470.jpg') HTTP/1.1" 204 0
2026-03-28 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_cd5e0a3b7de44fba7163588ded75b470.jpg saved to cache
2026-03-28 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 682c8746-35a8-577a-a11a-26bef4f3d65b
2026-03-28 07:30:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f07faf87490>
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 07:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_682c8746-35a8-577a-a11a-26bef4f3d65b/682c8746-35a8-577a-a11a-26bef4f3d65b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fef%252F80ef2b17f477d0cd21445eea670e8e3a%252Fpa%252FRU40516_0aebcfd02865ba1bc8f68f5727f8d8be.jpg') HTTP/1.1" 204 0
2026-03-28 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_0aebcfd02865ba1bc8f68f5727f8d8be.jpg saved to cache
2026-03-28 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 682c8746-35a8-577a-a11a-26bef4f3d65b
2026-03-28 07:30:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 682c8746-35a8-577a-a11a-26bef4f3d65b, skipping ID generation
2026-03-28 07:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 682c8746-35a8-577a-a11a-26bef4f3d65b with scrape type 1
2026-03-28 07:30:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 682c8746-35a8-577a-a11a-26bef4f3d65b sending to next pipeline
2026-03-28 07:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 682c8746-35a8-577a-a11a-26bef4f3d65b, identifier: RU40516
2026-03-28 07:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 682c8746-35a8-577a-a11a-26bef4f3d65b with identifier: RU40516
2026-03-28 07:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 682c8746-35a8-577a-a11a-26bef4f3d65b with identifier: RU40516
2026-03-28 07:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 682c8746-35a8-577a-a11a-26bef4f3d65b with identifier: RU40516 to the API
2026-03-28 07:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_0aebcfd02865ba1bc8f68f5727f8d8be.jpg>
{'auction_title': '',
'c_o_2_emission_value': 170,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:06:43Z',
'fuel_type': 'petrol',
'id': '682c8746-35a8-577a-a11a-26bef4f3d65b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU40516',
'listing': 'auction',
'location': 'DE, Bremen',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 98720,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_682c8746-35a8-577a-a11a-26bef4f3d65b/682c8746-35a8-577a-a11a-26bef4f3d65b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89255,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_13789fa0be72313e4daef1ce81a2675a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_682c8746-35a8-577a-a11a-26bef4f3d65b/682c8746-35a8-577a-a11a-26bef4f3d65b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2649729,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_0aebcfd02865ba1bc8f68f5727f8d8be.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_682c8746-35a8-577a-a11a-26bef4f3d65b/682c8746-35a8-577a-a11a-26bef4f3d65b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2545100,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_e4268189e79db2f891db548afaf98899.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_682c8746-35a8-577a-a11a-26bef4f3d65b/682c8746-35a8-577a-a11a-26bef4f3d65b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2342230,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_a616446ebffca56ce466b293c2cadbf8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_682c8746-35a8-577a-a11a-26bef4f3d65b/682c8746-35a8-577a-a11a-26bef4f3d65b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2495652,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_cd5e0a3b7de44fba7163588ded75b470.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_682c8746-35a8-577a-a11a-26bef4f3d65b/682c8746-35a8-577a-a11a-26bef4f3d65b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2182282,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_40decbc879a782f0aaefefcbd0569602.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_682c8746-35a8-577a-a11a-26bef4f3d65b/682c8746-35a8-577a-a11a-26bef4f3d65b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52699,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_9ceb43c17e412219a70d281c6d4fdd6f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_682c8746-35a8-577a-a11a-26bef4f3d65b/682c8746-35a8-577a-a11a-26bef4f3d65b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1258069,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_ecbf1dab3f83c66195c185fcec211247.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_682c8746-35a8-577a-a11a-26bef4f3d65b/682c8746-35a8-577a-a11a-26bef4f3d65b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79331,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_01d93e2e2560d77562db87f72de48045.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_682c8746-35a8-577a-a11a-26bef4f3d65b/682c8746-35a8-577a-a11a-26bef4f3d65b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58772,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img80/ef/80ef2b17f477d0cd21445eea670e8e3a/pa/RU40516_4a78a310a2cda149236cafa71dedd13b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-01-02',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TSI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2017}
2026-03-28 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU40516%27 HTTP/1.1" 200 None
2026-03-28 07:30:46 [auto1.de] INFO: Saving data for RU40516: {'created_time': 1774683046.63461, 'last_price_update_time': 1774683046.634622, 'auction_closing_time': 1774883203.0}
2026-03-28 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU40516') HTTP/1.1" 204 0
2026-03-28 07:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:30:46 [auto1.de] INFO: Channel: 24h | Page: 3 | totalHits: 9247 | hits on page: 40
2026-03-28 07:30:46 [auto1.de] INFO: Found listing with ID: BS96565
2026-03-28 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS96565%27 HTTP/1.1" 200 None
2026-03-28 07:30:46 [auto1.de] INFO: Scrape type for BS96565: 0
2026-03-28 07:30:46 [auto1.de] INFO: Found listing with ID: EA77246
2026-03-28 07:30:46 [auto1.de] INFO: Found listing with ID: KL38868
2026-03-28 07:30:46 [auto1.de] INFO: Found listing with ID: BP25717
2026-03-28 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP25717%27 HTTP/1.1" 200 None
2026-03-28 07:30:46 [auto1.de] INFO: Scrape type for BP25717: 0
2026-03-28 07:30:46 [auto1.de] INFO: Found listing with ID: AG68555
2026-03-28 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68555%27 HTTP/1.1" 200 None
2026-03-28 07:30:46 [auto1.de] INFO: Scrape type for AG68555: 0
2026-03-28 07:30:46 [auto1.de] INFO: Found listing with ID: PU72162
2026-03-28 07:30:46 [auto1.de] INFO: Found listing with ID: SD88360
2026-03-28 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD88360%27 HTTP/1.1" 200 None
2026-03-28 07:30:46 [auto1.de] INFO: Scrape type for SD88360: 0
2026-03-28 07:30:46 [auto1.de] INFO: Found listing with ID: SD15904
2026-03-28 07:30:46 [auto1.de] INFO: Found listing with ID: JT47484
2026-03-28 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT47484%27 HTTP/1.1" 200 None
2026-03-28 07:30:46 [auto1.de] INFO: Scrape type for JT47484: 0
2026-03-28 07:30:46 [auto1.de] INFO: Found listing with ID: PC15308
2026-03-28 07:30:46 [auto1.de] INFO: Found listing with ID: ME09470
2026-03-28 07:30:46 [auto1.de] INFO: Found listing with ID: HJ09616
2026-03-28 07:30:46 [auto1.de] INFO: Found listing with ID: CP73203
2026-03-28 07:30:46 [auto1.de] INFO: Found listing with ID: MS28207
2026-03-28 07:30:46 [auto1.de] INFO: Found listing with ID: ND29954
2026-03-28 07:30:46 [auto1.de] INFO: Found listing with ID: RA04600
2026-03-28 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA04600%27 HTTP/1.1" 200 None
2026-03-28 07:30:46 [auto1.de] INFO: Scrape type for RA04600: 0
2026-03-28 07:30:46 [auto1.de] INFO: Found listing with ID: XL55918
2026-03-28 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL55918%27 HTTP/1.1" 200 None
2026-03-28 07:30:46 [auto1.de] INFO: Scrape type for XL55918: 0
2026-03-28 07:30:46 [auto1.de] INFO: Found listing with ID: HL58412
2026-03-28 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL58412%27 HTTP/1.1" 200 None
2026-03-28 07:30:46 [auto1.de] INFO: Scrape type for HL58412: 0
2026-03-28 07:30:46 [auto1.de] INFO: Found listing with ID: NV14001
2026-03-28 07:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV14001%27 HTTP/1.1" 200 None
2026-03-28 07:30:47 [auto1.de] INFO: Scrape type for NV14001: 0
2026-03-28 07:30:47 [auto1.de] INFO: Found listing with ID: DB45591
2026-03-28 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB45591%27 HTTP/1.1" 200 None
2026-03-28 07:30:47 [auto1.de] INFO: Scrape type for DB45591: 2
2026-03-28 07:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04660417-8ff6-5e34-978c-91d9473a8eba with identifier: DB45591
2026-03-28 07:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04660417-8ff6-5e34-978c-91d9473a8eba with scrape type 2
2026-03-28 07:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04660417-8ff6-5e34-978c-91d9473a8eba with scrape type 2
2026-03-28 07:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04660417-8ff6-5e34-978c-91d9473a8eba, identifier: DB45591
2026-03-28 07:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04660417-8ff6-5e34-978c-91d9473a8eba with identifier: DB45591
2026-03-28 07:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04660417-8ff6-5e34-978c-91d9473a8eba with identifier: DB45591
2026-03-28 07:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04660417-8ff6-5e34-978c-91d9473a8eba with identifier: DB45591 to the API
2026-03-28 07:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 475,
'expiration_date': '2026-03-28T16:31:57Z',
'fuel_type': 'petrol',
'id': '04660417-8ff6-5e34-978c-91d9473a8eba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB45591',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 124586,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-12',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 63 AMG',
'transmission': 'automatic',
'trim': '',
'year': 2017}
2026-03-28 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB45591%27 HTTP/1.1" 200 None
2026-03-28 07:30:47 [auto1.de] INFO: Saving data for DB45591: {'auction_closing_time': 1774715517.0, 'created_time': 1773830355.091322, 'last_price_update_time': 1774683047.4204}
2026-03-28 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB45591') HTTP/1.1" 204 0
2026-03-28 07:30:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:30:47 [auto1.de] INFO: Found listing with ID: LG34778
2026-03-28 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG34778%27 HTTP/1.1" 200 None
2026-03-28 07:30:47 [auto1.de] INFO: Scrape type for LG34778: 2
2026-03-28 07:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cff09a4-d96a-5ed8-8c32-e520a372b3a0 with identifier: LG34778
2026-03-28 07:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cff09a4-d96a-5ed8-8c32-e520a372b3a0 with scrape type 2
2026-03-28 07:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cff09a4-d96a-5ed8-8c32-e520a372b3a0 with scrape type 2
2026-03-28 07:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3cff09a4-d96a-5ed8-8c32-e520a372b3a0, identifier: LG34778
2026-03-28 07:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3cff09a4-d96a-5ed8-8c32-e520a372b3a0 with identifier: LG34778
2026-03-28 07:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3cff09a4-d96a-5ed8-8c32-e520a372b3a0 with identifier: LG34778
2026-03-28 07:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3cff09a4-d96a-5ed8-8c32-e520a372b3a0 with identifier: LG34778 to the API
2026-03-28 07:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:11:01Z',
'fuel_type': 'petrol',
'id': '3cff09a4-d96a-5ed8-8c32-e520a372b3a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG34778',
'listing': 'auction',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 126736,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-13',
'seller_name': None,
'title': 'Jeep Renegade 1.4 M-Air Limited FWD',
'transmission': 'manual',
'trim': 'Limited FWD',
'year': 2016}
2026-03-28 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG34778%27 HTTP/1.1" 200 None
2026-03-28 07:30:47 [auto1.de] INFO: Saving data for LG34778: {'auction_closing_time': 1774714261.0, 'created_time': 1773830518.173451, 'last_price_update_time': 1774683047.938875}
2026-03-28 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG34778') HTTP/1.1" 204 0
2026-03-28 07:30:47 [auto1.de] INFO: Found listing with ID: GP45191
2026-03-28 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP45191%27 HTTP/1.1" 200 None
2026-03-28 07:30:47 [auto1.de] INFO: Scrape type for GP45191: 0
2026-03-28 07:30:47 [auto1.de] INFO: Found listing with ID: CB43306
2026-03-28 07:30:47 [auto1.de] INFO: Found listing with ID: AA51381
2026-03-28 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA51381%27 HTTP/1.1" 200 None
2026-03-28 07:30:47 [auto1.de] INFO: Scrape type for AA51381: 2
2026-03-28 07:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12bf6fc7-7c0c-50db-8ab7-51fecebff9ec with identifier: AA51381
2026-03-28 07:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12bf6fc7-7c0c-50db-8ab7-51fecebff9ec with scrape type 2
2026-03-28 07:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12bf6fc7-7c0c-50db-8ab7-51fecebff9ec with scrape type 2
2026-03-28 07:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12bf6fc7-7c0c-50db-8ab7-51fecebff9ec, identifier: AA51381
2026-03-28 07:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12bf6fc7-7c0c-50db-8ab7-51fecebff9ec with identifier: AA51381
2026-03-28 07:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12bf6fc7-7c0c-50db-8ab7-51fecebff9ec with identifier: AA51381
2026-03-28 07:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12bf6fc7-7c0c-50db-8ab7-51fecebff9ec with identifier: AA51381 to the API
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:56:44Z',
'fuel_type': 'diesel',
'id': '12bf6fc7-7c0c-50db-8ab7-51fecebff9ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA51381',
'listing': 'auction',
'make': 'Renault',
'model': 'Koleos',
'odometer': 81956,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-08',
'seller_name': None,
'title': 'Renault Koleos 2.0 BLUE dCi Limited 4x4',
'transmission': 'automatic',
'trim': 'Limited 4x4',
'year': 2021}
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA51381%27 HTTP/1.1" 200 None
2026-03-28 07:30:48 [auto1.de] INFO: Saving data for AA51381: {'auction_closing_time': 1774717004.0, 'created_time': 1773304719.727776, 'last_price_update_time': 1774683048.417277}
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA51381') HTTP/1.1" 204 0
2026-03-28 07:30:48 [auto1.de] INFO: Found listing with ID: JL74315
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL74315%27 HTTP/1.1" 200 None
2026-03-28 07:30:48 [auto1.de] INFO: Scrape type for JL74315: 2
2026-03-28 07:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26c04db0-d2b8-52e2-a48e-4c8fed4f5604 with identifier: JL74315
2026-03-28 07:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26c04db0-d2b8-52e2-a48e-4c8fed4f5604 with scrape type 2
2026-03-28 07:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26c04db0-d2b8-52e2-a48e-4c8fed4f5604 with scrape type 2
2026-03-28 07:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26c04db0-d2b8-52e2-a48e-4c8fed4f5604, identifier: JL74315
2026-03-28 07:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26c04db0-d2b8-52e2-a48e-4c8fed4f5604 with identifier: JL74315
2026-03-28 07:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26c04db0-d2b8-52e2-a48e-4c8fed4f5604 with identifier: JL74315
2026-03-28 07:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26c04db0-d2b8-52e2-a48e-4c8fed4f5604 with identifier: JL74315 to the API
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 204,
'expiration_date': '2026-03-28T16:55:27Z',
'fuel_type': 'diesel',
'id': '26c04db0-d2b8-52e2-a48e-4c8fed4f5604',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL74315',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 50885,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-29',
'seller_name': None,
'title': 'Audi A4 40 TDI Mild-Hybrid',
'transmission': 'automatic',
'trim': '',
'year': 2023}
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL74315%27 HTTP/1.1" 200 None
2026-03-28 07:30:48 [auto1.de] INFO: Saving data for JL74315: {'auction_closing_time': 1774716927.0, 'created_time': 1773830272.646965, 'last_price_update_time': 1774683048.839472}
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL74315') HTTP/1.1" 204 0
2026-03-28 07:30:48 [auto1.de] INFO: Found listing with ID: UF03548
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF03548%27 HTTP/1.1" 200 None
2026-03-28 07:30:48 [auto1.de] INFO: Scrape type for UF03548: 0
2026-03-28 07:30:48 [auto1.de] INFO: Found listing with ID: BB27376
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB27376%27 HTTP/1.1" 200 None
2026-03-28 07:30:48 [auto1.de] INFO: Scrape type for BB27376: 0
2026-03-28 07:30:48 [auto1.de] INFO: Found listing with ID: ZU14307
2026-03-28 07:30:48 [auto1.de] INFO: Found listing with ID: TN04984
2026-03-28 07:30:48 [auto1.de] INFO: Found listing with ID: AL26903
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL26903%27 HTTP/1.1" 200 None
2026-03-28 07:30:48 [auto1.de] INFO: Scrape type for AL26903: 0
2026-03-28 07:30:48 [auto1.de] INFO: Found listing with ID: XL09941
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL09941%27 HTTP/1.1" 200 None
2026-03-28 07:30:48 [auto1.de] INFO: Scrape type for XL09941: 0
2026-03-28 07:30:48 [auto1.de] INFO: Found listing with ID: ZM37202
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM37202%27 HTTP/1.1" 200 None
2026-03-28 07:30:48 [auto1.de] INFO: Scrape type for ZM37202: 0
2026-03-28 07:30:48 [auto1.de] INFO: Found listing with ID: GR29564
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR29564%27 HTTP/1.1" 200 None
2026-03-28 07:30:48 [auto1.de] INFO: Scrape type for GR29564: 0
2026-03-28 07:30:48 [auto1.de] INFO: Found listing with ID: ZK43120
2026-03-28 07:30:48 [auto1.de] INFO: Found listing with ID: GZ43118
2026-03-28 07:30:48 [auto1.de] INFO: Found listing with ID: CX18884
2026-03-28 07:30:48 [auto1.de] INFO: Found listing with ID: PG01901
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG01901%27 HTTP/1.1" 200 None
2026-03-28 07:30:48 [auto1.de] INFO: Scrape type for PG01901: 0
2026-03-28 07:30:48 [auto1.de] INFO: Found listing with ID: NA32054
2026-03-28 07:30:48 [auto1.de] INFO: Found listing with ID: XB18292
2026-03-28 07:30:48 [auto1.de] INFO: Found listing with ID: XB21556
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB21556%27 HTTP/1.1" 200 None
2026-03-28 07:30:48 [auto1.de] INFO: Scrape type for XB21556: 0
2026-03-28 07:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:30:59 [auto1.de] INFO: Channel: 24h | Page: 4 | totalHits: 9248 | hits on page: 40
2026-03-28 07:30:59 [auto1.de] INFO: Found listing with ID: XB21556
2026-03-28 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB21556%27 HTTP/1.1" 200 None
2026-03-28 07:30:59 [auto1.de] INFO: Scrape type for XB21556: 0
2026-03-28 07:30:59 [auto1.de] INFO: Found listing with ID: VH56486
2026-03-28 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH56486%27 HTTP/1.1" 200 None
2026-03-28 07:30:59 [auto1.de] INFO: Scrape type for VH56486: 0
2026-03-28 07:30:59 [auto1.de] INFO: Found listing with ID: DJ14237
2026-03-28 07:30:59 [auto1.de] INFO: Found listing with ID: AL45510
2026-03-28 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL45510%27 HTTP/1.1" 200 None
2026-03-28 07:30:59 [auto1.de] INFO: Scrape type for AL45510: 0
2026-03-28 07:30:59 [auto1.de] INFO: Found listing with ID: SB60272
2026-03-28 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB60272%27 HTTP/1.1" 200 None
2026-03-28 07:30:59 [auto1.de] INFO: Scrape type for SB60272: 0
2026-03-28 07:30:59 [auto1.de] INFO: Found listing with ID: EV68047
2026-03-28 07:30:59 [auto1.de] INFO: Found listing with ID: CF39305
2026-03-28 07:30:59 [auto1.de] INFO: Found listing with ID: YL20431
2026-03-28 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL20431%27 HTTP/1.1" 200 None
2026-03-28 07:30:59 [auto1.de] INFO: Scrape type for YL20431: 0
2026-03-28 07:30:59 [auto1.de] INFO: Found listing with ID: VT68593
2026-03-28 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT68593%27 HTTP/1.1" 200 None
2026-03-28 07:30:59 [auto1.de] INFO: Scrape type for VT68593: 0
2026-03-28 07:30:59 [auto1.de] INFO: Found listing with ID: CW80278
2026-03-28 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW80278%27 HTTP/1.1" 200 None
2026-03-28 07:30:59 [auto1.de] INFO: Scrape type for CW80278: 0
2026-03-28 07:30:59 [auto1.de] INFO: Found listing with ID: DB13775
2026-03-28 07:30:59 [auto1.de] INFO: Found listing with ID: UK49641
2026-03-28 07:30:59 [auto1.de] INFO: Found listing with ID: HF86895
2026-03-28 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF86895%27 HTTP/1.1" 200 None
2026-03-28 07:30:59 [auto1.de] INFO: Scrape type for HF86895: 0
2026-03-28 07:30:59 [auto1.de] INFO: Found listing with ID: TY58494
2026-03-28 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY58494%27 HTTP/1.1" 200 None
2026-03-28 07:30:59 [auto1.de] INFO: Scrape type for TY58494: 0
2026-03-28 07:30:59 [auto1.de] INFO: Found listing with ID: HD93241
2026-03-28 07:30:59 [auto1.de] INFO: Found listing with ID: JP54532
2026-03-28 07:30:59 [auto1.de] INFO: Found listing with ID: NW08152
2026-03-28 07:30:59 [auto1.de] INFO: Found listing with ID: DL51973
2026-03-28 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL51973%27 HTTP/1.1" 200 None
2026-03-28 07:30:59 [auto1.de] INFO: Scrape type for DL51973: 0
2026-03-28 07:30:59 [auto1.de] INFO: Found listing with ID: CF85526
2026-03-28 07:30:59 [auto1.de] INFO: Found listing with ID: TY55023
2026-03-28 07:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY55023%27 HTTP/1.1" 200 None
2026-03-28 07:31:00 [auto1.de] INFO: Scrape type for TY55023: 0
2026-03-28 07:31:00 [auto1.de] INFO: Found listing with ID: VU36237
2026-03-28 07:31:00 [auto1.de] INFO: Found listing with ID: WE98596
2026-03-28 07:31:00 [auto1.de] INFO: Found listing with ID: KR71178
2026-03-28 07:31:00 [auto1.de] INFO: Found listing with ID: PK60768
2026-03-28 07:31:00 [auto1.de] INFO: Found listing with ID: NA89904
2026-03-28 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA89904%27 HTTP/1.1" 200 None
2026-03-28 07:31:00 [auto1.de] INFO: Scrape type for NA89904: 0
2026-03-28 07:31:00 [auto1.de] INFO: Found listing with ID: FK75470
2026-03-28 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK75470%27 HTTP/1.1" 200 None
2026-03-28 07:31:00 [auto1.de] INFO: Scrape type for FK75470: 0
2026-03-28 07:31:00 [auto1.de] INFO: Found listing with ID: ZS55646
2026-03-28 07:31:00 [auto1.de] INFO: Found listing with ID: UT75774
2026-03-28 07:31:00 [auto1.de] INFO: Found listing with ID: CD75324
2026-03-28 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD75324%27 HTTP/1.1" 200 None
2026-03-28 07:31:00 [auto1.de] INFO: Scrape type for CD75324: 0
2026-03-28 07:31:00 [auto1.de] INFO: Found listing with ID: WV19329
2026-03-28 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV19329%27 HTTP/1.1" 200 None
2026-03-28 07:31:00 [auto1.de] INFO: Scrape type for WV19329: 0
2026-03-28 07:31:00 [auto1.de] INFO: Found listing with ID: FP33840
2026-03-28 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP33840%27 HTTP/1.1" 200 None
2026-03-28 07:31:00 [auto1.de] INFO: Scrape type for FP33840: 0
2026-03-28 07:31:00 [auto1.de] INFO: Found listing with ID: WC28097
2026-03-28 07:31:00 [auto1.de] INFO: Found listing with ID: XW71594
2026-03-28 07:31:00 [auto1.de] INFO: Found listing with ID: ZA94755
2026-03-28 07:31:00 [auto1.de] INFO: Found listing with ID: BY91581
2026-03-28 07:31:00 [auto1.de] INFO: Found listing with ID: XC25059
2026-03-28 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC25059%27 HTTP/1.1" 200 None
2026-03-28 07:31:00 [auto1.de] INFO: Scrape type for XC25059: 0
2026-03-28 07:31:00 [auto1.de] INFO: Found listing with ID: EE06188
2026-03-28 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE06188%27 HTTP/1.1" 200 None
2026-03-28 07:31:00 [auto1.de] INFO: Scrape type for EE06188: 0
2026-03-28 07:31:00 [auto1.de] INFO: Found listing with ID: SM47095
2026-03-28 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM47095%27 HTTP/1.1" 200 None
2026-03-28 07:31:00 [auto1.de] INFO: Scrape type for SM47095: 0
2026-03-28 07:31:00 [auto1.de] INFO: Found listing with ID: KT07926
2026-03-28 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT07926%27 HTTP/1.1" 200 None
2026-03-28 07:31:00 [auto1.de] INFO: Scrape type for KT07926: 0
2026-03-28 07:31:00 [auto1.de] INFO: Found listing with ID: BM57132
2026-03-28 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM57132%27 HTTP/1.1" 200 None
2026-03-28 07:31:00 [auto1.de] INFO: Scrape type for BM57132: 0
2026-03-28 07:31:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:31:01 [auto1.de] INFO: Channel: 24h | Page: 5 | totalHits: 9248 | hits on page: 40
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: SJ79213
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ79213%27 HTTP/1.1" 200 None
2026-03-28 07:31:01 [auto1.de] INFO: Scrape type for SJ79213: 0
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: LF00683
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF00683%27 HTTP/1.1" 200 None
2026-03-28 07:31:01 [auto1.de] INFO: Scrape type for LF00683: 0
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: ZK01329
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: KC24735
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: EJ80176
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: SG14649
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: NY39865
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY39865%27 HTTP/1.1" 200 None
2026-03-28 07:31:01 [auto1.de] INFO: Scrape type for NY39865: 0
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: BX53792
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: GX32204
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: VL06718
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL06718%27 HTTP/1.1" 200 None
2026-03-28 07:31:01 [auto1.de] INFO: Scrape type for VL06718: 0
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: EJ52813
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ52813%27 HTTP/1.1" 200 None
2026-03-28 07:31:01 [auto1.de] INFO: Scrape type for EJ52813: 0
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: ZK29983
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK29983%27 HTTP/1.1" 200 None
2026-03-28 07:31:01 [auto1.de] INFO: Scrape type for ZK29983: 0
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: UZ43781
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: AW80903
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: HP02844
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP02844%27 HTTP/1.1" 200 None
2026-03-28 07:31:01 [auto1.de] INFO: Scrape type for HP02844: 0
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: KA91193
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: LU01716
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: ES71771
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES71771%27 HTTP/1.1" 200 None
2026-03-28 07:31:01 [auto1.de] INFO: Scrape type for ES71771: 0
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: BD76424
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: PN07086
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN07086%27 HTTP/1.1" 200 None
2026-03-28 07:31:01 [auto1.de] INFO: Scrape type for PN07086: 0
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: BL23866
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: BJ94385
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: WB04317
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: KV57112
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: EM80186
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: BX45513
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: MR23018
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR23018%27 HTTP/1.1" 200 None
2026-03-28 07:31:01 [auto1.de] INFO: Scrape type for MR23018: 0
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: VF70690
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: VF27254
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: LW02583
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: YT00833
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: YM15583
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: ST29936
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST29936%27 HTTP/1.1" 200 None
2026-03-28 07:31:01 [auto1.de] INFO: Scrape type for ST29936: 0
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: SN13100
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: CV30078
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: DV57223
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: BC73900
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC73900%27 HTTP/1.1" 200 None
2026-03-28 07:31:01 [auto1.de] INFO: Scrape type for BC73900: 0
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: FK07510
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: JA06342
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA06342%27 HTTP/1.1" 200 None
2026-03-28 07:31:01 [auto1.de] INFO: Scrape type for JA06342: 0
2026-03-28 07:31:01 [auto1.de] INFO: Found listing with ID: PU94869
2026-03-28 07:31:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:31:02 [auto1.de] INFO: Channel: 24h | Page: 6 | totalHits: 9248 | hits on page: 40
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: CF34401
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: ND25281
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND25281%27 HTTP/1.1" 200 None
2026-03-28 07:31:02 [auto1.de] INFO: Scrape type for ND25281: 0
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: VB56822
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB56822%27 HTTP/1.1" 200 None
2026-03-28 07:31:02 [auto1.de] INFO: Scrape type for VB56822: 0
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: TJ50695
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: SV05588
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: JB03080
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB03080%27 HTTP/1.1" 200 None
2026-03-28 07:31:02 [auto1.de] INFO: Scrape type for JB03080: 0
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: KT65416
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: UK84754
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK84754%27 HTTP/1.1" 200 None
2026-03-28 07:31:02 [auto1.de] INFO: Scrape type for UK84754: 0
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: BX84490
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: GC82813
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC82813%27 HTTP/1.1" 200 None
2026-03-28 07:31:02 [auto1.de] INFO: Scrape type for GC82813: 0
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: ZA25327
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: SL53901
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL53901%27 HTTP/1.1" 200 None
2026-03-28 07:31:02 [auto1.de] INFO: Scrape type for SL53901: 0
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: UB59521
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: RY91957
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY91957%27 HTTP/1.1" 200 None
2026-03-28 07:31:02 [auto1.de] INFO: Scrape type for RY91957: 0
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: WN78953
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: LK11873
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: XK18770
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK18770%27 HTTP/1.1" 200 None
2026-03-28 07:31:02 [auto1.de] INFO: Scrape type for XK18770: 0
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: RV72396
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: GU59921
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: HC05500
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: ZZ74816
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: LW69749
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: US80422
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US80422%27 HTTP/1.1" 200 None
2026-03-28 07:31:02 [auto1.de] INFO: Scrape type for US80422: 0
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: PT81220
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT81220%27 HTTP/1.1" 200 None
2026-03-28 07:31:02 [auto1.de] INFO: Scrape type for PT81220: 0
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: ZD67638
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: PD00543
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD00543%27 HTTP/1.1" 200 None
2026-03-28 07:31:02 [auto1.de] INFO: Scrape type for PD00543: 0
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: YK88723
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK88723%27 HTTP/1.1" 200 None
2026-03-28 07:31:02 [auto1.de] INFO: Scrape type for YK88723: 0
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: AA46272
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA46272%27 HTTP/1.1" 200 None
2026-03-28 07:31:02 [auto1.de] INFO: Scrape type for AA46272: 0
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: XS38036
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS38036%27 HTTP/1.1" 200 None
2026-03-28 07:31:02 [auto1.de] INFO: Scrape type for XS38036: 0
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: SM91292
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM91292%27 HTTP/1.1" 200 None
2026-03-28 07:31:02 [auto1.de] INFO: Scrape type for SM91292: 0
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: KL70058
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: BY58400
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY58400%27 HTTP/1.1" 200 None
2026-03-28 07:31:02 [auto1.de] INFO: Scrape type for BY58400: 0
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: ET94101
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: AH85059
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: LK78678
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: VC01658
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC01658%27 HTTP/1.1" 200 None
2026-03-28 07:31:02 [auto1.de] INFO: Scrape type for VC01658: 0
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: VA54301
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: TF71705
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF71705%27 HTTP/1.1" 200 None
2026-03-28 07:31:02 [auto1.de] INFO: Scrape type for TF71705: 0
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: YJ68996
2026-03-28 07:31:02 [auto1.de] INFO: Found listing with ID: WB36208
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB36208%27 HTTP/1.1" 200 None
2026-03-28 07:31:02 [auto1.de] INFO: Scrape type for WB36208: 0
2026-03-28 07:31:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:31:04 [auto1.de] INFO: Channel: 24h | Page: 7 | totalHits: 9248 | hits on page: 40
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: MF11383
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF11383%27 HTTP/1.1" 200 None
2026-03-28 07:31:04 [auto1.de] INFO: Scrape type for MF11383: 0
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: WN56158
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN56158%27 HTTP/1.1" 200 None
2026-03-28 07:31:04 [auto1.de] INFO: Scrape type for WN56158: 0
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: TB15479
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: CS76015
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: TE23487
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE23487%27 HTTP/1.1" 200 None
2026-03-28 07:31:04 [auto1.de] INFO: Scrape type for TE23487: 0
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: HG88982
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: NG07529
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG07529%27 HTTP/1.1" 200 None
2026-03-28 07:31:04 [auto1.de] INFO: Scrape type for NG07529: 0
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: ST04128
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: UZ43090
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: NP24686
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP24686%27 HTTP/1.1" 200 None
2026-03-28 07:31:04 [auto1.de] INFO: Scrape type for NP24686: 0
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: PJ23427
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ23427%27 HTTP/1.1" 200 None
2026-03-28 07:31:04 [auto1.de] INFO: Scrape type for PJ23427: 0
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: NF91917
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF91917%27 HTTP/1.1" 200 None
2026-03-28 07:31:04 [auto1.de] INFO: Scrape type for NF91917: 0
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: BU32595
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: EV58982
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: SH55749
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: JJ68009
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: YS84502
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS84502%27 HTTP/1.1" 200 None
2026-03-28 07:31:04 [auto1.de] INFO: Scrape type for YS84502: 0
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: EN88282
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: TC10738
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: YJ27680
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ27680%27 HTTP/1.1" 200 None
2026-03-28 07:31:04 [auto1.de] INFO: Scrape type for YJ27680: 0
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: TE32041
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE32041%27 HTTP/1.1" 200 None
2026-03-28 07:31:04 [auto1.de] INFO: Scrape type for TE32041: 0
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: GJ71722
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71722%27 HTTP/1.1" 200 None
2026-03-28 07:31:04 [auto1.de] INFO: Scrape type for GJ71722: 0
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: ZF02079
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF02079%27 HTTP/1.1" 200 None
2026-03-28 07:31:04 [auto1.de] INFO: Scrape type for ZF02079: 0
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: BZ42354
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: PW56805
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW56805%27 HTTP/1.1" 200 None
2026-03-28 07:31:04 [auto1.de] INFO: Scrape type for PW56805: 0
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: AG47249
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG47249%27 HTTP/1.1" 200 None
2026-03-28 07:31:04 [auto1.de] INFO: Scrape type for AG47249: 0
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: CK29715
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK29715%27 HTTP/1.1" 200 None
2026-03-28 07:31:04 [auto1.de] INFO: Scrape type for CK29715: 0
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: CM58161
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: AN36712
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: HX15626
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX15626%27 HTTP/1.1" 200 None
2026-03-28 07:31:04 [auto1.de] INFO: Scrape type for HX15626: 0
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: DN49518
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN49518%27 HTTP/1.1" 200 None
2026-03-28 07:31:04 [auto1.de] INFO: Scrape type for DN49518: 0
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: RX10948
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: VH92759
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: XY67074
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY67074%27 HTTP/1.1" 200 None
2026-03-28 07:31:04 [auto1.de] INFO: Scrape type for XY67074: 0
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: ML67017
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: KR66468
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR66468%27 HTTP/1.1" 200 None
2026-03-28 07:31:04 [auto1.de] INFO: Scrape type for KR66468: 0
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: TT27495
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: ZF64276
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF64276%27 HTTP/1.1" 200 None
2026-03-28 07:31:04 [auto1.de] INFO: Scrape type for ZF64276: 0
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: CD03678
2026-03-28 07:31:04 [auto1.de] INFO: Found listing with ID: GX41654
2026-03-28 07:31:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:31:05 [auto1.de] INFO: Channel: 24h | Page: 8 | totalHits: 9248 | hits on page: 40
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: YT52370
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: ZE67546
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE67546%27 HTTP/1.1" 200 None
2026-03-28 07:31:05 [auto1.de] INFO: Scrape type for ZE67546: 0
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: VV75383
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: SZ97715
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: XT71149
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT71149%27 HTTP/1.1" 200 None
2026-03-28 07:31:05 [auto1.de] INFO: Scrape type for XT71149: 0
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: KC37462
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: RB39093
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: FX57031
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: MF29481
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF29481%27 HTTP/1.1" 200 None
2026-03-28 07:31:05 [auto1.de] INFO: Scrape type for MF29481: 0
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: PM88586
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: EV97888
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: TR13409
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: TL72332
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL72332%27 HTTP/1.1" 200 None
2026-03-28 07:31:05 [auto1.de] INFO: Scrape type for TL72332: 0
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: GW97412
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: GH93549
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH93549%27 HTTP/1.1" 200 None
2026-03-28 07:31:05 [auto1.de] INFO: Scrape type for GH93549: 0
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: MR61415
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR61415%27 HTTP/1.1" 200 None
2026-03-28 07:31:05 [auto1.de] INFO: Scrape type for MR61415: 0
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: GE07622
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE07622%27 HTTP/1.1" 200 None
2026-03-28 07:31:05 [auto1.de] INFO: Scrape type for GE07622: 0
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: YB13434
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: LG84508
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: DN72961
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: MJ31328
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: XS82974
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: WY73016
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY73016%27 HTTP/1.1" 200 None
2026-03-28 07:31:05 [auto1.de] INFO: Scrape type for WY73016: 0
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: RC37998
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC37998%27 HTTP/1.1" 200 None
2026-03-28 07:31:05 [auto1.de] INFO: Scrape type for RC37998: 0
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: GH39417
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: BD21444
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: LU56386
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU56386%27 HTTP/1.1" 200 None
2026-03-28 07:31:05 [auto1.de] INFO: Scrape type for LU56386: 0
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: HK50070
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: VV46079
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV46079%27 HTTP/1.1" 200 None
2026-03-28 07:31:05 [auto1.de] INFO: Scrape type for VV46079: 0
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: AB20934
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB20934%27 HTTP/1.1" 200 None
2026-03-28 07:31:05 [auto1.de] INFO: Scrape type for AB20934: 0
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: SJ47682
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ47682%27 HTTP/1.1" 200 None
2026-03-28 07:31:05 [auto1.de] INFO: Scrape type for SJ47682: 0
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: FX68518
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX68518%27 HTTP/1.1" 200 None
2026-03-28 07:31:05 [auto1.de] INFO: Scrape type for FX68518: 0
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: SG14297
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: BV47016
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV47016%27 HTTP/1.1" 200 None
2026-03-28 07:31:05 [auto1.de] INFO: Scrape type for BV47016: 0
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: JF90132
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF90132%27 HTTP/1.1" 200 None
2026-03-28 07:31:05 [auto1.de] INFO: Scrape type for JF90132: 0
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: PH00076
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH00076%27 HTTP/1.1" 200 None
2026-03-28 07:31:05 [auto1.de] INFO: Scrape type for PH00076: 0
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: CU59576
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: ER31380
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: CU11315
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU11315%27 HTTP/1.1" 200 None
2026-03-28 07:31:05 [auto1.de] INFO: Scrape type for CU11315: 0
2026-03-28 07:31:05 [auto1.de] INFO: Found listing with ID: KN67174
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN67174%27 HTTP/1.1" 200 None
2026-03-28 07:31:05 [auto1.de] INFO: Scrape type for KN67174: 0
2026-03-28 07:31:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:31:06 [scrapy.extensions.logstats] INFO: Crawled 14 pages (at 14 pages/min), scraped 39 items (at 39 items/min)
2026-03-28 07:31:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 165MiB
2026-03-28 07:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:31:06 [auto1.de] INFO: Channel: 24h | Page: 9 | totalHits: 9248 | hits on page: 40
2026-03-28 07:31:06 [auto1.de] INFO: Found listing with ID: LM10122
2026-03-28 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM10122%27 HTTP/1.1" 200 None
2026-03-28 07:31:06 [auto1.de] INFO: Scrape type for LM10122: 0
2026-03-28 07:31:06 [auto1.de] INFO: Found listing with ID: PT52067
2026-03-28 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT52067%27 HTTP/1.1" 200 None
2026-03-28 07:31:06 [auto1.de] INFO: Scrape type for PT52067: 0
2026-03-28 07:31:06 [auto1.de] INFO: Found listing with ID: XJ24379
2026-03-28 07:31:06 [auto1.de] INFO: Found listing with ID: DP78752
2026-03-28 07:31:06 [auto1.de] INFO: Found listing with ID: LJ89575
2026-03-28 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ89575%27 HTTP/1.1" 200 None
2026-03-28 07:31:06 [auto1.de] INFO: Scrape type for LJ89575: 0
2026-03-28 07:31:06 [auto1.de] INFO: Found listing with ID: YU93919
2026-03-28 07:31:06 [auto1.de] INFO: Found listing with ID: JD98482
2026-03-28 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD98482%27 HTTP/1.1" 200 None
2026-03-28 07:31:06 [auto1.de] INFO: Scrape type for JD98482: 0
2026-03-28 07:31:06 [auto1.de] INFO: Found listing with ID: CM30450
2026-03-28 07:31:06 [auto1.de] INFO: Found listing with ID: PT06802
2026-03-28 07:31:06 [auto1.de] INFO: Found listing with ID: CH30601
2026-03-28 07:31:06 [auto1.de] INFO: Found listing with ID: MA42451
2026-03-28 07:31:06 [auto1.de] INFO: Found listing with ID: UT25770
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT25770%27 HTTP/1.1" 200 None
2026-03-28 07:31:07 [auto1.de] INFO: Scrape type for UT25770: 0
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: GT00768
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT00768%27 HTTP/1.1" 200 None
2026-03-28 07:31:07 [auto1.de] INFO: Scrape type for GT00768: 0
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: HK24290
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: UP66494
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP66494%27 HTTP/1.1" 200 None
2026-03-28 07:31:07 [auto1.de] INFO: Scrape type for UP66494: 0
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: BP81340
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: FD81187
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD81187%27 HTTP/1.1" 200 None
2026-03-28 07:31:07 [auto1.de] INFO: Scrape type for FD81187: 0
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: HF53882
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF53882%27 HTTP/1.1" 200 None
2026-03-28 07:31:07 [auto1.de] INFO: Scrape type for HF53882: 0
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: MX06399
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: XX93407
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: EG14085
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG14085%27 HTTP/1.1" 200 None
2026-03-28 07:31:07 [auto1.de] INFO: Scrape type for EG14085: 0
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: SE90134
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE90134%27 HTTP/1.1" 200 None
2026-03-28 07:31:07 [auto1.de] INFO: Scrape type for SE90134: 0
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: GN38725
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: GK43362
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK43362%27 HTTP/1.1" 200 None
2026-03-28 07:31:07 [auto1.de] INFO: Scrape type for GK43362: 0
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: LZ73425
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ73425%27 HTTP/1.1" 200 None
2026-03-28 07:31:07 [auto1.de] INFO: Scrape type for LZ73425: 0
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: PV39921
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: UM40776
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: PR48691
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR48691%27 HTTP/1.1" 200 None
2026-03-28 07:31:07 [auto1.de] INFO: Scrape type for PR48691: 0
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: BR11811
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR11811%27 HTTP/1.1" 200 None
2026-03-28 07:31:07 [auto1.de] INFO: Scrape type for BR11811: 0
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: WD47381
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: BX52311
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: HF45615
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: MU06358
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU06358%27 HTTP/1.1" 200 None
2026-03-28 07:31:07 [auto1.de] INFO: Scrape type for MU06358: 0
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: MK98498
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: XB63697
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: NU76337
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: TE36715
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE36715%27 HTTP/1.1" 200 None
2026-03-28 07:31:07 [auto1.de] INFO: Scrape type for TE36715: 0
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: NE19972
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: KN06513
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN06513%27 HTTP/1.1" 200 None
2026-03-28 07:31:07 [auto1.de] INFO: Scrape type for KN06513: 0
2026-03-28 07:31:07 [auto1.de] INFO: Found listing with ID: EX28790
2026-03-28 07:31:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:31:08 [auto1.de] INFO: Channel: 24h | Page: 10 | totalHits: 9248 | hits on page: 40
2026-03-28 07:31:08 [auto1.de] INFO: Found listing with ID: UB28690
2026-03-28 07:31:08 [auto1.de] INFO: Found listing with ID: GE34935
2026-03-28 07:31:08 [auto1.de] INFO: Found listing with ID: ES37621
2026-03-28 07:31:08 [auto1.de] INFO: Found listing with ID: HZ35615
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35615%27 HTTP/1.1" 200 None
2026-03-28 07:31:08 [auto1.de] INFO: Scrape type for HZ35615: 0
2026-03-28 07:31:08 [auto1.de] INFO: Found listing with ID: LK84028
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK84028%27 HTTP/1.1" 200 None
2026-03-28 07:31:08 [auto1.de] INFO: Scrape type for LK84028: 0
2026-03-28 07:31:08 [auto1.de] INFO: Found listing with ID: CD36674
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD36674%27 HTTP/1.1" 200 None
2026-03-28 07:31:08 [auto1.de] INFO: Scrape type for CD36674: 0
2026-03-28 07:31:08 [auto1.de] INFO: Found listing with ID: JM07569
2026-03-28 07:31:08 [auto1.de] INFO: Found listing with ID: FV70322
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV70322%27 HTTP/1.1" 200 None
2026-03-28 07:31:08 [auto1.de] INFO: Scrape type for FV70322: 0
2026-03-28 07:31:08 [auto1.de] INFO: Found listing with ID: YH66607
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH66607%27 HTTP/1.1" 200 None
2026-03-28 07:31:08 [auto1.de] INFO: Scrape type for YH66607: 0
2026-03-28 07:31:08 [auto1.de] INFO: Found listing with ID: GR02584
2026-03-28 07:31:08 [auto1.de] INFO: Found listing with ID: WM97258
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM97258%27 HTTP/1.1" 200 None
2026-03-28 07:31:08 [auto1.de] INFO: Scrape type for WM97258: 0
2026-03-28 07:31:08 [auto1.de] INFO: Found listing with ID: NY21344
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY21344%27 HTTP/1.1" 200 None
2026-03-28 07:31:08 [auto1.de] INFO: Scrape type for NY21344: 0
2026-03-28 07:31:08 [auto1.de] INFO: Found listing with ID: YY45695
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY45695%27 HTTP/1.1" 200 None
2026-03-28 07:31:08 [auto1.de] INFO: Scrape type for YY45695: 0
2026-03-28 07:31:08 [auto1.de] INFO: Found listing with ID: RG19382
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG19382%27 HTTP/1.1" 200 None
2026-03-28 07:31:08 [auto1.de] INFO: Scrape type for RG19382: 0
2026-03-28 07:31:08 [auto1.de] INFO: Found listing with ID: JB27524
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB27524%27 HTTP/1.1" 200 None
2026-03-28 07:31:08 [auto1.de] INFO: Scrape type for JB27524: 0
2026-03-28 07:31:08 [auto1.de] INFO: Found listing with ID: VP25295
2026-03-28 07:31:08 [auto1.de] INFO: Found listing with ID: DV44550
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV44550%27 HTTP/1.1" 200 None
2026-03-28 07:31:08 [auto1.de] INFO: Scrape type for DV44550: 0
2026-03-28 07:31:08 [auto1.de] INFO: Found listing with ID: MZ72093
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72093%27 HTTP/1.1" 200 None
2026-03-28 07:31:08 [auto1.de] INFO: Scrape type for MZ72093: 0
2026-03-28 07:31:08 [auto1.de] INFO: Found listing with ID: RT03172
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT03172%27 HTTP/1.1" 200 None
2026-03-28 07:31:08 [auto1.de] INFO: Scrape type for RT03172: 2
2026-03-28 07:31:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31692785-d037-535b-b2a4-57da027d702d with identifier: RT03172
2026-03-28 07:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31692785-d037-535b-b2a4-57da027d702d with scrape type 2
2026-03-28 07:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31692785-d037-535b-b2a4-57da027d702d with scrape type 2
2026-03-28 07:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31692785-d037-535b-b2a4-57da027d702d, identifier: RT03172
2026-03-28 07:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31692785-d037-535b-b2a4-57da027d702d with identifier: RT03172
2026-03-28 07:31:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31692785-d037-535b-b2a4-57da027d702d with identifier: RT03172
2026-03-28 07:31:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31692785-d037-535b-b2a4-57da027d702d with identifier: RT03172 to the API
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:30:11Z',
'fuel_type': 'diesel',
'id': '31692785-d037-535b-b2a4-57da027d702d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT03172',
'listing': 'auction',
'make': 'Renault',
'model': 'Master',
'odometer': 261785,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-04',
'seller_name': None,
'title': 'Renault Master 2.3 dCi L2H2 HKa 3,5t',
'transmission': 'manual',
'trim': 'L2H2 HKa 3,5t',
'year': 2021}
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT03172%27 HTTP/1.1" 200 None
2026-03-28 07:31:09 [auto1.de] INFO: Saving data for RT03172: {'auction_closing_time': 1774715411.0, 'created_time': 1774467190.993049, 'last_price_update_time': 1774683069.437441}
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT03172') HTTP/1.1" 204 0
2026-03-28 07:31:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:31:09 [auto1.de] INFO: Found listing with ID: MN73743
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN73743%27 HTTP/1.1" 200 None
2026-03-28 07:31:09 [auto1.de] INFO: Scrape type for MN73743: 0
2026-03-28 07:31:09 [auto1.de] INFO: Found listing with ID: NJ66077
2026-03-28 07:31:09 [auto1.de] INFO: Found listing with ID: XG23027
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG23027%27 HTTP/1.1" 200 None
2026-03-28 07:31:09 [auto1.de] INFO: Scrape type for XG23027: 0
2026-03-28 07:31:09 [auto1.de] INFO: Found listing with ID: UV23463
2026-03-28 07:31:09 [auto1.de] INFO: Found listing with ID: KX75586
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX75586%27 HTTP/1.1" 200 None
2026-03-28 07:31:09 [auto1.de] INFO: Scrape type for KX75586: 0
2026-03-28 07:31:09 [auto1.de] INFO: Found listing with ID: JD23265
2026-03-28 07:31:09 [auto1.de] INFO: Found listing with ID: WP12836
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP12836%27 HTTP/1.1" 200 None
2026-03-28 07:31:09 [auto1.de] INFO: Scrape type for WP12836: 0
2026-03-28 07:31:09 [auto1.de] INFO: Found listing with ID: GT14298
2026-03-28 07:31:09 [auto1.de] INFO: Found listing with ID: AZ36706
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ36706%27 HTTP/1.1" 200 None
2026-03-28 07:31:09 [auto1.de] INFO: Scrape type for AZ36706: 0
2026-03-28 07:31:09 [auto1.de] INFO: Found listing with ID: ZK33939
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK33939%27 HTTP/1.1" 200 None
2026-03-28 07:31:09 [auto1.de] INFO: Scrape type for ZK33939: 0
2026-03-28 07:31:09 [auto1.de] INFO: Found listing with ID: XR25495
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR25495%27 HTTP/1.1" 200 None
2026-03-28 07:31:09 [auto1.de] INFO: Scrape type for XR25495: 0
2026-03-28 07:31:09 [auto1.de] INFO: Found listing with ID: CC17090
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC17090%27 HTTP/1.1" 200 None
2026-03-28 07:31:09 [auto1.de] INFO: Scrape type for CC17090: 0
2026-03-28 07:31:09 [auto1.de] INFO: Found listing with ID: DW36097
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW36097%27 HTTP/1.1" 200 None
2026-03-28 07:31:09 [auto1.de] INFO: Scrape type for DW36097: 0
2026-03-28 07:31:09 [auto1.de] INFO: Found listing with ID: KL53394
2026-03-28 07:31:09 [auto1.de] INFO: Found listing with ID: LS65332
2026-03-28 07:31:09 [auto1.de] INFO: Found listing with ID: EB80315
2026-03-28 07:31:09 [auto1.de] INFO: Found listing with ID: TK28110
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK28110%27 HTTP/1.1" 200 None
2026-03-28 07:31:09 [auto1.de] INFO: Scrape type for TK28110: 0
2026-03-28 07:31:09 [auto1.de] INFO: Found listing with ID: TB76582
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB76582%27 HTTP/1.1" 200 None
2026-03-28 07:31:09 [auto1.de] INFO: Scrape type for TB76582: 2
2026-03-28 07:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c723ca7-07dc-5721-a5ac-6b11d6993863 with identifier: TB76582
2026-03-28 07:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c723ca7-07dc-5721-a5ac-6b11d6993863 with scrape type 2
2026-03-28 07:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c723ca7-07dc-5721-a5ac-6b11d6993863 with scrape type 2
2026-03-28 07:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c723ca7-07dc-5721-a5ac-6b11d6993863, identifier: TB76582
2026-03-28 07:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c723ca7-07dc-5721-a5ac-6b11d6993863 with identifier: TB76582
2026-03-28 07:31:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c723ca7-07dc-5721-a5ac-6b11d6993863 with identifier: TB76582
2026-03-28 07:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c723ca7-07dc-5721-a5ac-6b11d6993863 with identifier: TB76582 to the API
2026-03-28 07:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:37:24Z',
'fuel_type': 'diesel',
'id': '9c723ca7-07dc-5721-a5ac-6b11d6993863',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB76582',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 140937,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-02',
'seller_name': None,
'title': 'Seat Ibiza 1.6 TDI FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2019}
2026-03-28 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB76582%27 HTTP/1.1" 200 None
2026-03-28 07:31:10 [auto1.de] INFO: Saving data for TB76582: {'auction_closing_time': 1774715844.0, 'created_time': 1774467869.662911, 'last_price_update_time': 1774683070.237716}
2026-03-28 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB76582') HTTP/1.1" 204 0
2026-03-28 07:31:10 [auto1.de] INFO: Found listing with ID: FW04904
2026-03-28 07:31:10 [auto1.de] INFO: Found listing with ID: XM92815
2026-03-28 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM92815%27 HTTP/1.1" 200 None
2026-03-28 07:31:10 [auto1.de] INFO: Scrape type for XM92815: 0
2026-03-28 07:31:10 [auto1.de] INFO: Found listing with ID: GK45349
2026-03-28 07:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:31:11 [auto1.de] INFO: Channel: 24h | Page: 11 | totalHits: 9248 | hits on page: 40
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: YR17987
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR17987%27 HTTP/1.1" 200 None
2026-03-28 07:31:11 [auto1.de] INFO: Scrape type for YR17987: 0
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: FY87536
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY87536%27 HTTP/1.1" 200 None
2026-03-28 07:31:11 [auto1.de] INFO: Scrape type for FY87536: 0
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: WG96363
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG96363%27 HTTP/1.1" 200 None
2026-03-28 07:31:11 [auto1.de] INFO: Scrape type for WG96363: 0
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: ZP12024
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP12024%27 HTTP/1.1" 200 None
2026-03-28 07:31:11 [auto1.de] INFO: Scrape type for ZP12024: 0
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: MF56816
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: BE83152
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: HG90812
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG90812%27 HTTP/1.1" 200 None
2026-03-28 07:31:11 [auto1.de] INFO: Scrape type for HG90812: 2
2026-03-28 07:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5fa66be-d4ca-5ad4-95b8-a5fb43d993af with identifier: HG90812
2026-03-28 07:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5fa66be-d4ca-5ad4-95b8-a5fb43d993af with scrape type 2
2026-03-28 07:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5fa66be-d4ca-5ad4-95b8-a5fb43d993af with scrape type 2
2026-03-28 07:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5fa66be-d4ca-5ad4-95b8-a5fb43d993af, identifier: HG90812
2026-03-28 07:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5fa66be-d4ca-5ad4-95b8-a5fb43d993af with identifier: HG90812
2026-03-28 07:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5fa66be-d4ca-5ad4-95b8-a5fb43d993af with identifier: HG90812
2026-03-28 07:31:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5fa66be-d4ca-5ad4-95b8-a5fb43d993af with identifier: HG90812 to the API
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-28T16:06:56Z',
'fuel_type': 'diesel',
'id': 'b5fa66be-d4ca-5ad4-95b8-a5fb43d993af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG90812',
'listing': 'auction',
'make': 'Kia',
'model': 'Sorento',
'odometer': 134131,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-02',
'seller_name': None,
'title': 'Kia Sorento 2.2 CRDi Platinum Edition 4WD',
'transmission': 'automatic',
'trim': 'Platinum Edition 4WD',
'year': 2015}
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG90812%27 HTTP/1.1" 200 None
2026-03-28 07:31:11 [auto1.de] INFO: Saving data for HG90812: {'auction_closing_time': 1774714016.0, 'created_time': 1774467475.196115, 'last_price_update_time': 1774683071.733284}
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG90812') HTTP/1.1" 204 0
2026-03-28 07:31:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: ZT59384
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT59384%27 HTTP/1.1" 200 None
2026-03-28 07:31:11 [auto1.de] INFO: Scrape type for ZT59384: 0
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: KK74048
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: PY20785
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY20785%27 HTTP/1.1" 200 None
2026-03-28 07:31:11 [auto1.de] INFO: Scrape type for PY20785: 0
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: KC39120
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC39120%27 HTTP/1.1" 200 None
2026-03-28 07:31:11 [auto1.de] INFO: Scrape type for KC39120: 0
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: NF92899
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF92899%27 HTTP/1.1" 200 None
2026-03-28 07:31:11 [auto1.de] INFO: Scrape type for NF92899: 0
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: TA25179
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: VK99504
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: BE14691
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: HK08818
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: NU04580
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: YR03483
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR03483%27 HTTP/1.1" 200 None
2026-03-28 07:31:11 [auto1.de] INFO: Scrape type for YR03483: 0
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: XK43305
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: VK29322
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK29322%27 HTTP/1.1" 200 None
2026-03-28 07:31:11 [auto1.de] INFO: Scrape type for VK29322: 0
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: WC33817
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: JZ88566
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: SX40861
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: DY95504
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: JE79416
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE79416%27 HTTP/1.1" 200 None
2026-03-28 07:31:11 [auto1.de] INFO: Scrape type for JE79416: 0
2026-03-28 07:31:11 [auto1.de] INFO: Found listing with ID: MJ40039
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ40039%27 HTTP/1.1" 200 None
2026-03-28 07:31:11 [auto1.de] INFO: Scrape type for MJ40039: 2
2026-03-28 07:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8d73a0b-e24f-52c1-9cae-880ab32cea15 with identifier: MJ40039
2026-03-28 07:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8d73a0b-e24f-52c1-9cae-880ab32cea15 with scrape type 2
2026-03-28 07:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8d73a0b-e24f-52c1-9cae-880ab32cea15 with scrape type 2
2026-03-28 07:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8d73a0b-e24f-52c1-9cae-880ab32cea15, identifier: MJ40039
2026-03-28 07:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8d73a0b-e24f-52c1-9cae-880ab32cea15 with identifier: MJ40039
2026-03-28 07:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8d73a0b-e24f-52c1-9cae-880ab32cea15 with identifier: MJ40039
2026-03-28 07:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8d73a0b-e24f-52c1-9cae-880ab32cea15 with identifier: MJ40039 to the API
2026-03-28 07:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:45:37Z',
'fuel_type': 'petrol',
'id': 'b8d73a0b-e24f-52c1-9cae-880ab32cea15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ40039',
'listing': 'auction',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 24360,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-19',
'seller_name': None,
'title': 'Toyota Aygo 1.0 X-Play Touch',
'transmission': 'manual',
'trim': 'X-Play Touch',
'year': 2016}
2026-03-28 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ40039%27 HTTP/1.1" 200 None
2026-03-28 07:31:12 [auto1.de] INFO: Saving data for MJ40039: {'auction_closing_time': 1774716337.0, 'created_time': 1774464844.0842, 'last_price_update_time': 1774683072.267505}
2026-03-28 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ40039') HTTP/1.1" 204 0
2026-03-28 07:31:12 [auto1.de] INFO: Found listing with ID: PH95596
2026-03-28 07:31:12 [auto1.de] INFO: Found listing with ID: WC38783
2026-03-28 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC38783%27 HTTP/1.1" 200 None
2026-03-28 07:31:12 [auto1.de] INFO: Scrape type for WC38783: 0
2026-03-28 07:31:12 [auto1.de] INFO: Found listing with ID: LH77373
2026-03-28 07:31:12 [auto1.de] INFO: Found listing with ID: UG43365
2026-03-28 07:31:12 [auto1.de] INFO: Found listing with ID: HP12660
2026-03-28 07:31:12 [auto1.de] INFO: Found listing with ID: HE35464
2026-03-28 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE35464%27 HTTP/1.1" 200 None
2026-03-28 07:31:12 [auto1.de] INFO: Scrape type for HE35464: 0
2026-03-28 07:31:12 [auto1.de] INFO: Found listing with ID: UD40582
2026-03-28 07:31:12 [auto1.de] INFO: Found listing with ID: PU06584
2026-03-28 07:31:12 [auto1.de] INFO: Found listing with ID: XA03133
2026-03-28 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA03133%27 HTTP/1.1" 200 None
2026-03-28 07:31:12 [auto1.de] INFO: Scrape type for XA03133: 0
2026-03-28 07:31:12 [auto1.de] INFO: Found listing with ID: UP05296
2026-03-28 07:31:12 [auto1.de] INFO: Found listing with ID: FJ62780
2026-03-28 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ62780%27 HTTP/1.1" 200 None
2026-03-28 07:31:12 [auto1.de] INFO: Scrape type for FJ62780: 2
2026-03-28 07:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc54d74f-0a39-5658-b316-07c9ab997a1a with identifier: FJ62780
2026-03-28 07:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc54d74f-0a39-5658-b316-07c9ab997a1a with scrape type 2
2026-03-28 07:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc54d74f-0a39-5658-b316-07c9ab997a1a with scrape type 2
2026-03-28 07:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc54d74f-0a39-5658-b316-07c9ab997a1a, identifier: FJ62780
2026-03-28 07:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc54d74f-0a39-5658-b316-07c9ab997a1a with identifier: FJ62780
2026-03-28 07:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc54d74f-0a39-5658-b316-07c9ab997a1a with identifier: FJ62780
2026-03-28 07:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc54d74f-0a39-5658-b316-07c9ab997a1a with identifier: FJ62780 to the API
2026-03-28 07:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-28T16:07:17Z',
'fuel_type': 'petrol',
'id': 'cc54d74f-0a39-5658-b316-07c9ab997a1a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ62780',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 164139,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-05-04',
'seller_name': None,
'title': 'BMW 3er 325i',
'transmission': 'manual',
'trim': '',
'year': 2006}
2026-03-28 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ62780%27 HTTP/1.1" 200 None
2026-03-28 07:31:12 [auto1.de] INFO: Saving data for FJ62780: {'auction_closing_time': 1774714037.0, 'created_time': 1774466389.224061, 'last_price_update_time': 1774683072.837368}
2026-03-28 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ62780') HTTP/1.1" 204 0
2026-03-28 07:31:12 [auto1.de] INFO: Found listing with ID: JE58161
2026-03-28 07:31:12 [auto1.de] INFO: Found listing with ID: JH64089
2026-03-28 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH64089%27 HTTP/1.1" 200 None
2026-03-28 07:31:12 [auto1.de] INFO: Scrape type for JH64089: 0
2026-03-28 07:31:12 [auto1.de] INFO: Found listing with ID: BB15265
2026-03-28 07:31:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:31:13 [auto1.de] INFO: Channel: 24h | Page: 12 | totalHits: 9248 | hits on page: 40
2026-03-28 07:31:13 [auto1.de] INFO: Found listing with ID: RW16668
2026-03-28 07:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW16668%27 HTTP/1.1" 200 None
2026-03-28 07:31:14 [auto1.de] INFO: Scrape type for RW16668: 0
2026-03-28 07:31:14 [auto1.de] INFO: Found listing with ID: RC23376
2026-03-28 07:31:14 [auto1.de] INFO: Found listing with ID: NZ53793
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ53793%27 HTTP/1.1" 200 None
2026-03-28 07:31:14 [auto1.de] INFO: Scrape type for NZ53793: 0
2026-03-28 07:31:14 [auto1.de] INFO: Found listing with ID: LC05735
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC05735%27 HTTP/1.1" 200 None
2026-03-28 07:31:14 [auto1.de] INFO: Scrape type for LC05735: 0
2026-03-28 07:31:14 [auto1.de] INFO: Found listing with ID: SC92751
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC92751%27 HTTP/1.1" 200 None
2026-03-28 07:31:14 [auto1.de] INFO: Scrape type for SC92751: 0
2026-03-28 07:31:14 [auto1.de] INFO: Found listing with ID: GV92310
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV92310%27 HTTP/1.1" 200 None
2026-03-28 07:31:14 [auto1.de] INFO: Scrape type for GV92310: 0
2026-03-28 07:31:14 [auto1.de] INFO: Found listing with ID: UC51546
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC51546%27 HTTP/1.1" 200 None
2026-03-28 07:31:14 [auto1.de] INFO: Scrape type for UC51546: 0
2026-03-28 07:31:14 [auto1.de] INFO: Found listing with ID: NV63188
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV63188%27 HTTP/1.1" 200 None
2026-03-28 07:31:14 [auto1.de] INFO: Scrape type for NV63188: 0
2026-03-28 07:31:14 [auto1.de] INFO: Found listing with ID: UG57897
2026-03-28 07:31:14 [auto1.de] INFO: Found listing with ID: ZC12806
2026-03-28 07:31:14 [auto1.de] INFO: Found listing with ID: SM33942
2026-03-28 07:31:14 [auto1.de] INFO: Found listing with ID: BW22563
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW22563%27 HTTP/1.1" 200 None
2026-03-28 07:31:14 [auto1.de] INFO: Scrape type for BW22563: 0
2026-03-28 07:31:14 [auto1.de] INFO: Found listing with ID: ZH21180
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH21180%27 HTTP/1.1" 200 None
2026-03-28 07:31:14 [auto1.de] INFO: Scrape type for ZH21180: 0
2026-03-28 07:31:14 [auto1.de] INFO: Found listing with ID: CH92359
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH92359%27 HTTP/1.1" 200 None
2026-03-28 07:31:14 [auto1.de] INFO: Scrape type for CH92359: 0
2026-03-28 07:31:14 [auto1.de] INFO: Found listing with ID: VP44882
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP44882%27 HTTP/1.1" 200 None
2026-03-28 07:31:14 [auto1.de] INFO: Scrape type for VP44882: 0
2026-03-28 07:31:14 [auto1.de] INFO: Found listing with ID: PU27308
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU27308%27 HTTP/1.1" 200 None
2026-03-28 07:31:14 [auto1.de] INFO: Scrape type for PU27308: 0
2026-03-28 07:31:14 [auto1.de] INFO: Found listing with ID: MF99655
2026-03-28 07:31:14 [auto1.de] INFO: Found listing with ID: DT00101
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT00101%27 HTTP/1.1" 200 None
2026-03-28 07:31:14 [auto1.de] INFO: Scrape type for DT00101: 0
2026-03-28 07:31:14 [auto1.de] INFO: Found listing with ID: KF20598
2026-03-28 07:31:14 [auto1.de] INFO: Found listing with ID: JE92990
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE92990%27 HTTP/1.1" 200 None
2026-03-28 07:31:14 [auto1.de] INFO: Scrape type for JE92990: 2
2026-03-28 07:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a56cab7-fca7-5cb0-85eb-24464d6b2035 with identifier: JE92990
2026-03-28 07:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a56cab7-fca7-5cb0-85eb-24464d6b2035 with scrape type 2
2026-03-28 07:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a56cab7-fca7-5cb0-85eb-24464d6b2035 with scrape type 2
2026-03-28 07:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a56cab7-fca7-5cb0-85eb-24464d6b2035, identifier: JE92990
2026-03-28 07:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a56cab7-fca7-5cb0-85eb-24464d6b2035 with identifier: JE92990
2026-03-28 07:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a56cab7-fca7-5cb0-85eb-24464d6b2035 with identifier: JE92990
2026-03-28 07:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a56cab7-fca7-5cb0-85eb-24464d6b2035 with identifier: JE92990 to the API
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:40:07Z',
'fuel_type': 'petrol',
'id': '7a56cab7-fca7-5cb0-85eb-24464d6b2035',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE92990',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 175271,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-14',
'seller_name': None,
'title': 'Volkswagen Golf V 1.4 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2009}
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE92990%27 HTTP/1.1" 200 None
2026-03-28 07:31:14 [auto1.de] INFO: Saving data for JE92990: {'auction_closing_time': 1774716007.0, 'created_time': 1774467903.007506, 'last_price_update_time': 1774683074.654228}
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE92990') HTTP/1.1" 204 0
2026-03-28 07:31:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:31:14 [auto1.de] INFO: Found listing with ID: CT69735
2026-03-28 07:31:14 [auto1.de] INFO: Found listing with ID: WV63025
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV63025%27 HTTP/1.1" 200 None
2026-03-28 07:31:14 [auto1.de] INFO: Scrape type for WV63025: 2
2026-03-28 07:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdcfde59-1edf-5257-bca0-6a061b3a91b5 with identifier: WV63025
2026-03-28 07:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdcfde59-1edf-5257-bca0-6a061b3a91b5 with scrape type 2
2026-03-28 07:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdcfde59-1edf-5257-bca0-6a061b3a91b5 with scrape type 2
2026-03-28 07:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdcfde59-1edf-5257-bca0-6a061b3a91b5, identifier: WV63025
2026-03-28 07:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdcfde59-1edf-5257-bca0-6a061b3a91b5 with identifier: WV63025
2026-03-28 07:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdcfde59-1edf-5257-bca0-6a061b3a91b5 with identifier: WV63025
2026-03-28 07:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdcfde59-1edf-5257-bca0-6a061b3a91b5 with identifier: WV63025 to the API
2026-03-28 07:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:10:33Z',
'fuel_type': 'diesel',
'id': 'cdcfde59-1edf-5257-bca0-6a061b3a91b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV63025',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 77721,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-20',
'seller_name': None,
'title': 'Nissan Qashqai 1.6 dCi Black Edition',
'transmission': 'automatic',
'trim': 'Black Edition',
'year': 2016}
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV63025%27 HTTP/1.1" 200 None
2026-03-28 07:31:15 [auto1.de] INFO: Saving data for WV63025: {'auction_closing_time': 1774714233.0, 'created_time': 1774467555.367898, 'last_price_update_time': 1774683075.207626}
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV63025') HTTP/1.1" 204 0
2026-03-28 07:31:15 [auto1.de] INFO: Found listing with ID: NR70794
2026-03-28 07:31:15 [auto1.de] INFO: Found listing with ID: NZ80756
2026-03-28 07:31:15 [auto1.de] INFO: Found listing with ID: CW24668
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW24668%27 HTTP/1.1" 200 None
2026-03-28 07:31:15 [auto1.de] INFO: Scrape type for CW24668: 0
2026-03-28 07:31:15 [auto1.de] INFO: Found listing with ID: DL13353
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL13353%27 HTTP/1.1" 200 None
2026-03-28 07:31:15 [auto1.de] INFO: Scrape type for DL13353: 0
2026-03-28 07:31:15 [auto1.de] INFO: Found listing with ID: MA94395
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA94395%27 HTTP/1.1" 200 None
2026-03-28 07:31:15 [auto1.de] INFO: Scrape type for MA94395: 0
2026-03-28 07:31:15 [auto1.de] INFO: Found listing with ID: GZ91789
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ91789%27 HTTP/1.1" 200 None
2026-03-28 07:31:15 [auto1.de] INFO: Scrape type for GZ91789: 2
2026-03-28 07:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2c36fdf-96eb-52e0-8e62-f2abb8acde8a with identifier: GZ91789
2026-03-28 07:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2c36fdf-96eb-52e0-8e62-f2abb8acde8a with scrape type 2
2026-03-28 07:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2c36fdf-96eb-52e0-8e62-f2abb8acde8a with scrape type 2
2026-03-28 07:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2c36fdf-96eb-52e0-8e62-f2abb8acde8a, identifier: GZ91789
2026-03-28 07:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2c36fdf-96eb-52e0-8e62-f2abb8acde8a with identifier: GZ91789
2026-03-28 07:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2c36fdf-96eb-52e0-8e62-f2abb8acde8a with identifier: GZ91789
2026-03-28 07:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2c36fdf-96eb-52e0-8e62-f2abb8acde8a with identifier: GZ91789 to the API
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:07:33Z',
'fuel_type': 'petrol',
'id': 'a2c36fdf-96eb-52e0-8e62-f2abb8acde8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ91789',
'listing': 'auction',
'make': 'Fiat',
'model': '500X',
'odometer': 59096,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-18',
'seller_name': None,
'title': 'Fiat 500X 1.4 Turbo Pop Star',
'transmission': 'manual',
'trim': 'Pop Star',
'year': 2017}
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ91789%27 HTTP/1.1" 200 None
2026-03-28 07:31:15 [auto1.de] INFO: Saving data for GZ91789: {'auction_closing_time': 1774714053.0, 'created_time': 1774034089.257846, 'last_price_update_time': 1774683075.75687}
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ91789') HTTP/1.1" 204 0
2026-03-28 07:31:15 [auto1.de] INFO: Found listing with ID: XE14279
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE14279%27 HTTP/1.1" 200 None
2026-03-28 07:31:15 [auto1.de] INFO: Scrape type for XE14279: 0
2026-03-28 07:31:15 [auto1.de] INFO: Found listing with ID: SG32034
2026-03-28 07:31:15 [auto1.de] INFO: Found listing with ID: KZ13921
2026-03-28 07:31:15 [auto1.de] INFO: Found listing with ID: FC39269
2026-03-28 07:31:15 [auto1.de] INFO: Found listing with ID: GF71655
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF71655%27 HTTP/1.1" 200 None
2026-03-28 07:31:15 [auto1.de] INFO: Scrape type for GF71655: 0
2026-03-28 07:31:15 [auto1.de] INFO: Found listing with ID: FY99153
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY99153%27 HTTP/1.1" 200 None
2026-03-28 07:31:15 [auto1.de] INFO: Scrape type for FY99153: 0
2026-03-28 07:31:15 [auto1.de] INFO: Found listing with ID: FW21931
2026-03-28 07:31:15 [auto1.de] INFO: Found listing with ID: WZ12668
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ12668%27 HTTP/1.1" 200 None
2026-03-28 07:31:15 [auto1.de] INFO: Scrape type for WZ12668: 2
2026-03-28 07:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff2bc14a-fecc-5736-9e8d-04a74c7d7a6a with identifier: WZ12668
2026-03-28 07:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff2bc14a-fecc-5736-9e8d-04a74c7d7a6a with scrape type 2
2026-03-28 07:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff2bc14a-fecc-5736-9e8d-04a74c7d7a6a with scrape type 2
2026-03-28 07:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff2bc14a-fecc-5736-9e8d-04a74c7d7a6a, identifier: WZ12668
2026-03-28 07:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff2bc14a-fecc-5736-9e8d-04a74c7d7a6a with identifier: WZ12668
2026-03-28 07:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff2bc14a-fecc-5736-9e8d-04a74c7d7a6a with identifier: WZ12668
2026-03-28 07:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff2bc14a-fecc-5736-9e8d-04a74c7d7a6a with identifier: WZ12668 to the API
2026-03-28 07:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 290,
'expiration_date': '2026-03-28T16:50:59Z',
'fuel_type': 'petrol',
'id': 'ff2bc14a-fecc-5736-9e8d-04a74c7d7a6a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ12668',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 150505,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-22',
'seller_name': None,
'title': 'Seat Leon 2.0 TSI Cupra 290',
'transmission': 'automatic',
'trim': 'Cupra 290',
'year': 2016}
2026-03-28 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ12668%27 HTTP/1.1" 200 None
2026-03-28 07:31:16 [auto1.de] INFO: Saving data for WZ12668: {'auction_closing_time': 1774716659.0, 'created_time': 1774465693.344458, 'last_price_update_time': 1774683076.276428}
2026-03-28 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ12668') HTTP/1.1" 204 0
2026-03-28 07:31:16 [auto1.de] INFO: Found listing with ID: ZR53559
2026-03-28 07:31:16 [auto1.de] INFO: Found listing with ID: YT11339
2026-03-28 07:31:16 [auto1.de] INFO: Found listing with ID: TX72935
2026-03-28 07:31:16 [auto1.de] INFO: Found listing with ID: UM61936
2026-03-28 07:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:31:17 [auto1.de] INFO: Channel: 24h | Page: 13 | totalHits: 9248 | hits on page: 40
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: AM47417
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM47417%27 HTTP/1.1" 200 None
2026-03-28 07:31:17 [auto1.de] INFO: Scrape type for AM47417: 0
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: UG86555
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: XV41644
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: NA57032
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: XJ33844
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: DF28851
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF28851%27 HTTP/1.1" 200 None
2026-03-28 07:31:17 [auto1.de] INFO: Scrape type for DF28851: 0
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: ER51376
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER51376%27 HTTP/1.1" 200 None
2026-03-28 07:31:17 [auto1.de] INFO: Scrape type for ER51376: 0
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: SK50267
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: BS50452
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS50452%27 HTTP/1.1" 200 None
2026-03-28 07:31:17 [auto1.de] INFO: Scrape type for BS50452: 0
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: TZ90006
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: JH84206
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH84206%27 HTTP/1.1" 200 None
2026-03-28 07:31:17 [auto1.de] INFO: Scrape type for JH84206: 0
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: UD72248
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD72248%27 HTTP/1.1" 200 None
2026-03-28 07:31:17 [auto1.de] INFO: Scrape type for UD72248: 0
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: TE29693
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: CE63611
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE63611%27 HTTP/1.1" 200 None
2026-03-28 07:31:17 [auto1.de] INFO: Scrape type for CE63611: 2
2026-03-28 07:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19954260-c1ab-50b7-a2e9-a65d35cfc950 with identifier: CE63611
2026-03-28 07:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19954260-c1ab-50b7-a2e9-a65d35cfc950 with scrape type 2
2026-03-28 07:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19954260-c1ab-50b7-a2e9-a65d35cfc950 with scrape type 2
2026-03-28 07:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19954260-c1ab-50b7-a2e9-a65d35cfc950, identifier: CE63611
2026-03-28 07:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19954260-c1ab-50b7-a2e9-a65d35cfc950 with identifier: CE63611
2026-03-28 07:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19954260-c1ab-50b7-a2e9-a65d35cfc950 with identifier: CE63611
2026-03-28 07:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19954260-c1ab-50b7-a2e9-a65d35cfc950 with identifier: CE63611 to the API
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:46:39Z',
'fuel_type': 'diesel',
'id': '19954260-c1ab-50b7-a2e9-a65d35cfc950',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE63611',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 106259,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-06',
'seller_name': None,
'title': 'Opel Astra 1.6 CDTI Business Start/Stop',
'transmission': 'manual',
'trim': 'Business Start/Stop',
'year': 2016}
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE63611%27 HTTP/1.1" 200 None
2026-03-28 07:31:17 [auto1.de] INFO: Saving data for CE63611: {'auction_closing_time': 1774716399.0, 'created_time': 1774467017.981173, 'last_price_update_time': 1774683077.767765}
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE63611') HTTP/1.1" 204 0
2026-03-28 07:31:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: UL75790
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: GJ77265
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ77265%27 HTTP/1.1" 200 None
2026-03-28 07:31:17 [auto1.de] INFO: Scrape type for GJ77265: 0
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: NE03141
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: CH49236
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: SV49639
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: RB67874
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: AU22690
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU22690%27 HTTP/1.1" 200 None
2026-03-28 07:31:17 [auto1.de] INFO: Scrape type for AU22690: 0
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: BD68188
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: XS52546
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: EN21542
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: AK95286
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: BB62931
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB62931%27 HTTP/1.1" 200 None
2026-03-28 07:31:17 [auto1.de] INFO: Scrape type for BB62931: 0
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: MA30458
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: HE21190
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE21190%27 HTTP/1.1" 200 None
2026-03-28 07:31:17 [auto1.de] INFO: Scrape type for HE21190: 0
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: XF22574
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: GW76676
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW76676%27 HTTP/1.1" 200 None
2026-03-28 07:31:17 [auto1.de] INFO: Scrape type for GW76676: 0
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: ZR39968
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: CP53358
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: CA88273
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA88273%27 HTTP/1.1" 200 None
2026-03-28 07:31:17 [auto1.de] INFO: Scrape type for CA88273: 0
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: HG88240
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: YJ97695
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: EW02544
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: HW68760
2026-03-28 07:31:17 [auto1.de] INFO: Found listing with ID: ZN04529
2026-03-28 07:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN04529%27 HTTP/1.1" 200 None
2026-03-28 07:31:18 [auto1.de] INFO: Scrape type for ZN04529: 0
2026-03-28 07:31:18 [auto1.de] INFO: Found listing with ID: AN41414
2026-03-28 07:31:18 [auto1.de] INFO: Found listing with ID: KF35020
2026-03-28 07:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:31:19 [auto1.de] INFO: Channel: 24h | Page: 14 | totalHits: 9248 | hits on page: 40
2026-03-28 07:31:19 [auto1.de] INFO: Found listing with ID: JM94296
2026-03-28 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM94296%27 HTTP/1.1" 200 None
2026-03-28 07:31:19 [auto1.de] INFO: Scrape type for JM94296: 0
2026-03-28 07:31:19 [auto1.de] INFO: Found listing with ID: NH88126
2026-03-28 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH88126%27 HTTP/1.1" 200 None
2026-03-28 07:31:19 [auto1.de] INFO: Scrape type for NH88126: 2
2026-03-28 07:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c3f737d-0aa3-5707-b303-fd00d8d775c0 with identifier: NH88126
2026-03-28 07:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c3f737d-0aa3-5707-b303-fd00d8d775c0 with scrape type 2
2026-03-28 07:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c3f737d-0aa3-5707-b303-fd00d8d775c0 with scrape type 2
2026-03-28 07:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c3f737d-0aa3-5707-b303-fd00d8d775c0, identifier: NH88126
2026-03-28 07:31:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c3f737d-0aa3-5707-b303-fd00d8d775c0 with identifier: NH88126
2026-03-28 07:31:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c3f737d-0aa3-5707-b303-fd00d8d775c0 with identifier: NH88126
2026-03-28 07:31:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c3f737d-0aa3-5707-b303-fd00d8d775c0 with identifier: NH88126 to the API
2026-03-28 07:31:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 165,
'expiration_date': '2026-03-28T16:47:15Z',
'fuel_type': 'diesel',
'id': '4c3f737d-0aa3-5707-b303-fd00d8d775c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH88126',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 175543,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-21',
'seller_name': None,
'title': 'Opel Astra 2.0 CDTI Exklusiv',
'transmission': 'automatic',
'trim': 'Exklusiv',
'year': 2014}
2026-03-28 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH88126%27 HTTP/1.1" 200 None
2026-03-28 07:31:19 [auto1.de] INFO: Saving data for NH88126: {'auction_closing_time': 1774716435.0, 'created_time': 1774466087.547351, 'last_price_update_time': 1774683079.853419}
2026-03-28 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH88126') HTTP/1.1" 204 0
2026-03-28 07:31:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:31:19 [auto1.de] INFO: Found listing with ID: EU09282
2026-03-28 07:31:19 [auto1.de] INFO: Found listing with ID: RN98053
2026-03-28 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN98053%27 HTTP/1.1" 200 None
2026-03-28 07:31:19 [auto1.de] INFO: Scrape type for RN98053: 0
2026-03-28 07:31:19 [auto1.de] INFO: Found listing with ID: KA83953
2026-03-28 07:31:19 [auto1.de] INFO: Found listing with ID: PX72797
2026-03-28 07:31:19 [auto1.de] INFO: Found listing with ID: KX24759
2026-03-28 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24759%27 HTTP/1.1" 200 None
2026-03-28 07:31:19 [auto1.de] INFO: Scrape type for KX24759: 2
2026-03-28 07:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4802c87-99a6-54bc-8b87-66bf9425d04d with identifier: KX24759
2026-03-28 07:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4802c87-99a6-54bc-8b87-66bf9425d04d with scrape type 2
2026-03-28 07:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4802c87-99a6-54bc-8b87-66bf9425d04d with scrape type 2
2026-03-28 07:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4802c87-99a6-54bc-8b87-66bf9425d04d, identifier: KX24759
2026-03-28 07:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4802c87-99a6-54bc-8b87-66bf9425d04d with identifier: KX24759
2026-03-28 07:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4802c87-99a6-54bc-8b87-66bf9425d04d with identifier: KX24759
2026-03-28 07:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4802c87-99a6-54bc-8b87-66bf9425d04d with identifier: KX24759 to the API
2026-03-28 07:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-28T16:06:03Z',
'fuel_type': 'diesel',
'id': 'd4802c87-99a6-54bc-8b87-66bf9425d04d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX24759',
'listing': 'auction',
'make': 'Kia',
'model': 'Sorento',
'odometer': 66698,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-02',
'seller_name': None,
'title': 'Kia Sorento 2.2 CRDi GT-Line 4WD',
'transmission': 'automatic',
'trim': 'GT-Line 4WD',
'year': 2020}
2026-03-28 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24759%27 HTTP/1.1" 200 None
2026-03-28 07:31:21 [auto1.de] INFO: Saving data for KX24759: {'auction_closing_time': 1774713963.0, 'created_time': 1774466214.925019, 'last_price_update_time': 1774683081.366727}
2026-03-28 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX24759') HTTP/1.1" 204 0
2026-03-28 07:31:21 [auto1.de] INFO: Found listing with ID: SA80165
2026-03-28 07:31:21 [auto1.de] INFO: Found listing with ID: PB81090
2026-03-28 07:31:21 [auto1.de] INFO: Found listing with ID: LD36602
2026-03-28 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD36602%27 HTTP/1.1" 200 None
2026-03-28 07:31:21 [auto1.de] INFO: Scrape type for LD36602: 0
2026-03-28 07:31:21 [auto1.de] INFO: Found listing with ID: SF55933
2026-03-28 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF55933%27 HTTP/1.1" 200 None
2026-03-28 07:31:21 [auto1.de] INFO: Scrape type for SF55933: 0
2026-03-28 07:31:21 [auto1.de] INFO: Found listing with ID: BE30085
2026-03-28 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE30085%27 HTTP/1.1" 200 None
2026-03-28 07:31:21 [auto1.de] INFO: Scrape type for BE30085: 0
2026-03-28 07:31:21 [auto1.de] INFO: Found listing with ID: SP97012
2026-03-28 07:31:21 [auto1.de] INFO: Found listing with ID: FH28762
2026-03-28 07:31:21 [auto1.de] INFO: Found listing with ID: LC01994
2026-03-28 07:31:21 [auto1.de] INFO: Found listing with ID: GF50389
2026-03-28 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF50389%27 HTTP/1.1" 200 None
2026-03-28 07:31:21 [auto1.de] INFO: Scrape type for GF50389: 2
2026-03-28 07:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87a55bbe-9322-55d0-bace-8571c2e937d2 with identifier: GF50389
2026-03-28 07:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87a55bbe-9322-55d0-bace-8571c2e937d2 with scrape type 2
2026-03-28 07:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87a55bbe-9322-55d0-bace-8571c2e937d2 with scrape type 2
2026-03-28 07:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87a55bbe-9322-55d0-bace-8571c2e937d2, identifier: GF50389
2026-03-28 07:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87a55bbe-9322-55d0-bace-8571c2e937d2 with identifier: GF50389
2026-03-28 07:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87a55bbe-9322-55d0-bace-8571c2e937d2 with identifier: GF50389
2026-03-28 07:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87a55bbe-9322-55d0-bace-8571c2e937d2 with identifier: GF50389 to the API
2026-03-28 07:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:05:47Z',
'fuel_type': 'diesel',
'id': '87a55bbe-9322-55d0-bace-8571c2e937d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF50389',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 158032,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-20',
'seller_name': None,
'title': 'Volkswagen Sharan 2.0 TDI Style BlueMotion',
'transmission': 'automatic',
'trim': 'Style BlueMotion',
'year': 2011}
2026-03-28 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF50389%27 HTTP/1.1" 200 None
2026-03-28 07:31:21 [auto1.de] INFO: Saving data for GF50389: {'auction_closing_time': 1774713947.0, 'created_time': 1774467464.182029, 'last_price_update_time': 1774683081.864405}
2026-03-28 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF50389') HTTP/1.1" 204 0
2026-03-28 07:31:21 [auto1.de] INFO: Found listing with ID: PB92284
2026-03-28 07:31:21 [auto1.de] INFO: Found listing with ID: KX26949
2026-03-28 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX26949%27 HTTP/1.1" 200 None
2026-03-28 07:31:21 [auto1.de] INFO: Scrape type for KX26949: 0
2026-03-28 07:31:21 [auto1.de] INFO: Found listing with ID: RP65815
2026-03-28 07:31:21 [auto1.de] INFO: Found listing with ID: CV06251
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV06251%27 HTTP/1.1" 200 None
2026-03-28 07:31:22 [auto1.de] INFO: Scrape type for CV06251: 0
2026-03-28 07:31:22 [auto1.de] INFO: Found listing with ID: NK69314
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK69314%27 HTTP/1.1" 200 None
2026-03-28 07:31:22 [auto1.de] INFO: Scrape type for NK69314: 0
2026-03-28 07:31:22 [auto1.de] INFO: Found listing with ID: EP32297
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP32297%27 HTTP/1.1" 200 None
2026-03-28 07:31:22 [auto1.de] INFO: Scrape type for EP32297: 0
2026-03-28 07:31:22 [auto1.de] INFO: Found listing with ID: ZD84444
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD84444%27 HTTP/1.1" 200 None
2026-03-28 07:31:22 [auto1.de] INFO: Scrape type for ZD84444: 0
2026-03-28 07:31:22 [auto1.de] INFO: Found listing with ID: DD38415
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD38415%27 HTTP/1.1" 200 None
2026-03-28 07:31:22 [auto1.de] INFO: Scrape type for DD38415: 0
2026-03-28 07:31:22 [auto1.de] INFO: Found listing with ID: GC53073
2026-03-28 07:31:22 [auto1.de] INFO: Found listing with ID: BZ91725
2026-03-28 07:31:22 [auto1.de] INFO: Found listing with ID: JS17929
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS17929%27 HTTP/1.1" 200 None
2026-03-28 07:31:22 [auto1.de] INFO: Scrape type for JS17929: 2
2026-03-28 07:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d02233f-2aad-5cdb-be25-c5d509cddc9c with identifier: JS17929
2026-03-28 07:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d02233f-2aad-5cdb-be25-c5d509cddc9c with scrape type 2
2026-03-28 07:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d02233f-2aad-5cdb-be25-c5d509cddc9c with scrape type 2
2026-03-28 07:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d02233f-2aad-5cdb-be25-c5d509cddc9c, identifier: JS17929
2026-03-28 07:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d02233f-2aad-5cdb-be25-c5d509cddc9c with identifier: JS17929
2026-03-28 07:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d02233f-2aad-5cdb-be25-c5d509cddc9c with identifier: JS17929
2026-03-28 07:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d02233f-2aad-5cdb-be25-c5d509cddc9c with identifier: JS17929 to the API
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 306,
'expiration_date': '2026-03-28T16:20:04Z',
'fuel_type': 'petrol',
'id': '3d02233f-2aad-5cdb-be25-c5d509cddc9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS17929',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 20533,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-26',
'seller_name': None,
'title': 'BMW 2er M235i Gran Coupe xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2020}
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS17929%27 HTTP/1.1" 200 None
2026-03-28 07:31:22 [auto1.de] INFO: Saving data for JS17929: {'auction_closing_time': 1774714804.0, 'created_time': 1774468013.418081, 'last_price_update_time': 1774683082.498447}
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS17929') HTTP/1.1" 204 0
2026-03-28 07:31:22 [auto1.de] INFO: Found listing with ID: WR98876
2026-03-28 07:31:22 [auto1.de] INFO: Found listing with ID: GZ10091
2026-03-28 07:31:22 [auto1.de] INFO: Found listing with ID: RH04581
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH04581%27 HTTP/1.1" 200 None
2026-03-28 07:31:22 [auto1.de] INFO: Scrape type for RH04581: 0
2026-03-28 07:31:22 [auto1.de] INFO: Found listing with ID: KY36378
2026-03-28 07:31:22 [auto1.de] INFO: Found listing with ID: YS74184
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS74184%27 HTTP/1.1" 200 None
2026-03-28 07:31:22 [auto1.de] INFO: Scrape type for YS74184: 0
2026-03-28 07:31:22 [auto1.de] INFO: Found listing with ID: EC83870
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC83870%27 HTTP/1.1" 200 None
2026-03-28 07:31:22 [auto1.de] INFO: Scrape type for EC83870: 2
2026-03-28 07:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c0e3207-5ea3-5c22-9271-ab796c8c557f with identifier: EC83870
2026-03-28 07:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c0e3207-5ea3-5c22-9271-ab796c8c557f with scrape type 2
2026-03-28 07:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c0e3207-5ea3-5c22-9271-ab796c8c557f with scrape type 2
2026-03-28 07:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c0e3207-5ea3-5c22-9271-ab796c8c557f, identifier: EC83870
2026-03-28 07:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c0e3207-5ea3-5c22-9271-ab796c8c557f with identifier: EC83870
2026-03-28 07:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c0e3207-5ea3-5c22-9271-ab796c8c557f with identifier: EC83870
2026-03-28 07:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c0e3207-5ea3-5c22-9271-ab796c8c557f with identifier: EC83870 to the API
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-28T16:12:56Z',
'fuel_type': 'diesel',
'id': '5c0e3207-5ea3-5c22-9271-ab796c8c557f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC83870',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 217936,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-20',
'seller_name': None,
'title': 'Audi A6 2.0 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC83870%27 HTTP/1.1" 200 None
2026-03-28 07:31:23 [auto1.de] INFO: Saving data for EC83870: {'auction_closing_time': 1774714376.0, 'created_time': 1774466152.092771, 'last_price_update_time': 1774683083.044023}
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC83870') HTTP/1.1" 204 0
2026-03-28 07:31:23 [auto1.de] INFO: Found listing with ID: ZN20945
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN20945%27 HTTP/1.1" 200 None
2026-03-28 07:31:23 [auto1.de] INFO: Scrape type for ZN20945: 0
2026-03-28 07:31:23 [auto1.de] INFO: Found listing with ID: CS62800
2026-03-28 07:31:23 [auto1.de] INFO: Found listing with ID: JG35901
2026-03-28 07:31:23 [auto1.de] INFO: Found listing with ID: FD48176
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD48176%27 HTTP/1.1" 200 None
2026-03-28 07:31:23 [auto1.de] INFO: Scrape type for FD48176: 0
2026-03-28 07:31:23 [auto1.de] INFO: Found listing with ID: GH78103
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH78103%27 HTTP/1.1" 200 None
2026-03-28 07:31:23 [auto1.de] INFO: Scrape type for GH78103: 2
2026-03-28 07:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d079457-2037-53a6-b73b-4f6b04c130dd with identifier: GH78103
2026-03-28 07:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d079457-2037-53a6-b73b-4f6b04c130dd with scrape type 2
2026-03-28 07:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d079457-2037-53a6-b73b-4f6b04c130dd with scrape type 2
2026-03-28 07:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d079457-2037-53a6-b73b-4f6b04c130dd, identifier: GH78103
2026-03-28 07:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d079457-2037-53a6-b73b-4f6b04c130dd with identifier: GH78103
2026-03-28 07:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d079457-2037-53a6-b73b-4f6b04c130dd with identifier: GH78103
2026-03-28 07:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d079457-2037-53a6-b73b-4f6b04c130dd with identifier: GH78103 to the API
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:53:31Z',
'fuel_type': 'petrol',
'id': '8d079457-2037-53a6-b73b-4f6b04c130dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH78103',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 24456,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-12',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Silver Edition',
'transmission': 'manual',
'trim': 'Silver Edition',
'year': 2009}
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH78103%27 HTTP/1.1" 200 None
2026-03-28 07:31:23 [auto1.de] INFO: Saving data for GH78103: {'auction_closing_time': 1774716811.0, 'created_time': 1774463627.301735, 'last_price_update_time': 1774683083.550745}
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH78103') HTTP/1.1" 204 0
2026-03-28 07:31:23 [auto1.de] INFO: Found listing with ID: HV40211
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV40211%27 HTTP/1.1" 200 None
2026-03-28 07:31:23 [auto1.de] INFO: Scrape type for HV40211: 0
2026-03-28 07:31:23 [auto1.de] INFO: Found listing with ID: KY48204
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY48204%27 HTTP/1.1" 200 None
2026-03-28 07:31:23 [auto1.de] INFO: Scrape type for KY48204: 0
2026-03-28 07:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:31:23 [auto1.de] INFO: Channel: 24h | Page: 15 | totalHits: 9248 | hits on page: 40
2026-03-28 07:31:23 [auto1.de] INFO: Found listing with ID: BB98508
2026-03-28 07:31:23 [auto1.de] INFO: Found listing with ID: AL65001
2026-03-28 07:31:23 [auto1.de] INFO: Found listing with ID: RM44288
2026-03-28 07:31:23 [auto1.de] INFO: Found listing with ID: UT62176
2026-03-28 07:31:23 [auto1.de] INFO: Found listing with ID: GZ21000
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ21000%27 HTTP/1.1" 200 None
2026-03-28 07:31:23 [auto1.de] INFO: Scrape type for GZ21000: 0
2026-03-28 07:31:23 [auto1.de] INFO: Found listing with ID: VE76243
2026-03-28 07:31:23 [auto1.de] INFO: Found listing with ID: WZ19127
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ19127%27 HTTP/1.1" 200 None
2026-03-28 07:31:23 [auto1.de] INFO: Scrape type for WZ19127: 0
2026-03-28 07:31:23 [auto1.de] INFO: Found listing with ID: LF06916
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF06916%27 HTTP/1.1" 200 None
2026-03-28 07:31:23 [auto1.de] INFO: Scrape type for LF06916: 2
2026-03-28 07:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54c984e6-3019-5d9b-b26f-fceab5b1b606 with identifier: LF06916
2026-03-28 07:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54c984e6-3019-5d9b-b26f-fceab5b1b606 with scrape type 2
2026-03-28 07:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54c984e6-3019-5d9b-b26f-fceab5b1b606 with scrape type 2
2026-03-28 07:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54c984e6-3019-5d9b-b26f-fceab5b1b606, identifier: LF06916
2026-03-28 07:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54c984e6-3019-5d9b-b26f-fceab5b1b606 with identifier: LF06916
2026-03-28 07:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54c984e6-3019-5d9b-b26f-fceab5b1b606 with identifier: LF06916
2026-03-28 07:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54c984e6-3019-5d9b-b26f-fceab5b1b606 with identifier: LF06916 to the API
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:31:06Z',
'fuel_type': 'diesel',
'id': '54c984e6-3019-5d9b-b26f-fceab5b1b606',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF06916',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Sprinter',
'odometer': 187257,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-25',
'seller_name': None,
'title': 'Mercedes-Benz Sprinter 316 CDI',
'transmission': 'manual',
'trim': '',
'year': 2015}
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF06916%27 HTTP/1.1" 200 None
2026-03-28 07:31:24 [auto1.de] INFO: Saving data for LF06916: {'auction_closing_time': 1774715466.0, 'created_time': 1774466658.007851, 'last_price_update_time': 1774683084.335498}
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF06916') HTTP/1.1" 204 0
2026-03-28 07:31:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: RJ18784
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: FX32627
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX32627%27 HTTP/1.1" 200 None
2026-03-28 07:31:24 [auto1.de] INFO: Scrape type for FX32627: 0
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: AP07103
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP07103%27 HTTP/1.1" 200 None
2026-03-28 07:31:24 [auto1.de] INFO: Scrape type for AP07103: 0
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: RT59975
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: BK98649
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK98649%27 HTTP/1.1" 200 None
2026-03-28 07:31:24 [auto1.de] INFO: Scrape type for BK98649: 0
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: EW88282
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW88282%27 HTTP/1.1" 200 None
2026-03-28 07:31:24 [auto1.de] INFO: Scrape type for EW88282: 0
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: MY48051
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: SP90277
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: VN21885
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN21885%27 HTTP/1.1" 200 None
2026-03-28 07:31:24 [auto1.de] INFO: Scrape type for VN21885: 0
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: PB50731
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB50731%27 HTTP/1.1" 200 None
2026-03-28 07:31:24 [auto1.de] INFO: Scrape type for PB50731: 0
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: EM77424
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM77424%27 HTTP/1.1" 200 None
2026-03-28 07:31:24 [auto1.de] INFO: Scrape type for EM77424: 0
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: HG38928
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG38928%27 HTTP/1.1" 200 None
2026-03-28 07:31:24 [auto1.de] INFO: Scrape type for HG38928: 0
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: UA59883
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: WT17427
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT17427%27 HTTP/1.1" 200 None
2026-03-28 07:31:24 [auto1.de] INFO: Scrape type for WT17427: 0
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: PP27281
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: XP68837
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: NY57954
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: SN40806
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: UN02057
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: JK52723
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: VR87804
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: KG80613
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: VL45063
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL45063%27 HTTP/1.1" 200 None
2026-03-28 07:31:24 [auto1.de] INFO: Scrape type for VL45063: 0
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: LG37465
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: MH85381
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH85381%27 HTTP/1.1" 200 None
2026-03-28 07:31:24 [auto1.de] INFO: Scrape type for MH85381: 0
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: AT55034
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT55034%27 HTTP/1.1" 200 None
2026-03-28 07:31:24 [auto1.de] INFO: Scrape type for AT55034: 0
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: ZT00838
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT00838%27 HTTP/1.1" 200 None
2026-03-28 07:31:24 [auto1.de] INFO: Scrape type for ZT00838: 0
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: KN98252
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: HY54013
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY54013%27 HTTP/1.1" 200 None
2026-03-28 07:31:24 [auto1.de] INFO: Scrape type for HY54013: 0
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: DN02562
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: PM99393
2026-03-28 07:31:24 [auto1.de] INFO: Found listing with ID: AR55742
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR55742%27 HTTP/1.1" 200 None
2026-03-28 07:31:24 [auto1.de] INFO: Scrape type for AR55742: 0
2026-03-28 07:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:31:26 [auto1.de] INFO: Channel: 24h | Page: 16 | totalHits: 9248 | hits on page: 40
2026-03-28 07:31:26 [auto1.de] INFO: Found listing with ID: KV84716
2026-03-28 07:31:26 [auto1.de] INFO: Found listing with ID: LW43520
2026-03-28 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW43520%27 HTTP/1.1" 200 None
2026-03-28 07:31:26 [auto1.de] INFO: Scrape type for LW43520: 0
2026-03-28 07:31:26 [auto1.de] INFO: Found listing with ID: FD57756
2026-03-28 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD57756%27 HTTP/1.1" 200 None
2026-03-28 07:31:26 [auto1.de] INFO: Scrape type for FD57756: 0
2026-03-28 07:31:26 [auto1.de] INFO: Found listing with ID: YH26863
2026-03-28 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH26863%27 HTTP/1.1" 200 None
2026-03-28 07:31:26 [auto1.de] INFO: Scrape type for YH26863: 0
2026-03-28 07:31:26 [auto1.de] INFO: Found listing with ID: PY40149
2026-03-28 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY40149%27 HTTP/1.1" 200 None
2026-03-28 07:31:26 [auto1.de] INFO: Scrape type for PY40149: 0
2026-03-28 07:31:26 [auto1.de] INFO: Found listing with ID: RJ73659
2026-03-28 07:31:26 [auto1.de] INFO: Found listing with ID: DJ54071
2026-03-28 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ54071%27 HTTP/1.1" 200 None
2026-03-28 07:31:26 [auto1.de] INFO: Scrape type for DJ54071: 0
2026-03-28 07:31:26 [auto1.de] INFO: Found listing with ID: DL36324
2026-03-28 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL36324%27 HTTP/1.1" 200 None
2026-03-28 07:31:26 [auto1.de] INFO: Scrape type for DL36324: 0
2026-03-28 07:31:26 [auto1.de] INFO: Found listing with ID: PP65062
2026-03-28 07:31:26 [auto1.de] INFO: Found listing with ID: KM25194
2026-03-28 07:31:26 [auto1.de] INFO: Found listing with ID: JD41613
2026-03-28 07:31:26 [auto1.de] INFO: Found listing with ID: RK08384
2026-03-28 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK08384%27 HTTP/1.1" 200 None
2026-03-28 07:31:26 [auto1.de] INFO: Scrape type for RK08384: 2
2026-03-28 07:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fafd7f62-d38d-5376-b77d-dad433bdd774 with identifier: RK08384
2026-03-28 07:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fafd7f62-d38d-5376-b77d-dad433bdd774 with scrape type 2
2026-03-28 07:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fafd7f62-d38d-5376-b77d-dad433bdd774 with scrape type 2
2026-03-28 07:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fafd7f62-d38d-5376-b77d-dad433bdd774, identifier: RK08384
2026-03-28 07:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fafd7f62-d38d-5376-b77d-dad433bdd774 with identifier: RK08384
2026-03-28 07:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fafd7f62-d38d-5376-b77d-dad433bdd774 with identifier: RK08384
2026-03-28 07:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fafd7f62-d38d-5376-b77d-dad433bdd774 with identifier: RK08384 to the API
2026-03-28 07:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:42:02Z',
'fuel_type': 'petrol',
'id': 'fafd7f62-d38d-5376-b77d-dad433bdd774',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK08384',
'listing': 'auction',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 123642,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-29',
'seller_name': None,
'title': 'Jeep Renegade 1.4 M-Air Limited FWD',
'transmission': 'manual',
'trim': 'Limited FWD',
'year': 2018}
2026-03-28 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK08384%27 HTTP/1.1" 200 None
2026-03-28 07:31:27 [auto1.de] INFO: Saving data for RK08384: {'auction_closing_time': 1774716122.0, 'created_time': 1774466856.735541, 'last_price_update_time': 1774683087.202793}
2026-03-28 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RK08384') HTTP/1.1" 204 0
2026-03-28 07:31:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:31:27 [auto1.de] INFO: Found listing with ID: LV91095
2026-03-28 07:31:27 [auto1.de] INFO: Found listing with ID: SM03586
2026-03-28 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM03586%27 HTTP/1.1" 200 None
2026-03-28 07:31:27 [auto1.de] INFO: Scrape type for SM03586: 0
2026-03-28 07:31:27 [auto1.de] INFO: Found listing with ID: PF34298
2026-03-28 07:31:27 [auto1.de] INFO: Found listing with ID: GE40777
2026-03-28 07:31:27 [auto1.de] INFO: Found listing with ID: DY72609
2026-03-28 07:31:27 [auto1.de] INFO: Found listing with ID: UG55505
2026-03-28 07:31:27 [auto1.de] INFO: Found listing with ID: JX74637
2026-03-28 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX74637%27 HTTP/1.1" 200 None
2026-03-28 07:31:27 [auto1.de] INFO: Scrape type for JX74637: 2
2026-03-28 07:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57e69cc5-747c-5e4d-a06b-cbb0cd1502ea with identifier: JX74637
2026-03-28 07:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57e69cc5-747c-5e4d-a06b-cbb0cd1502ea with scrape type 2
2026-03-28 07:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57e69cc5-747c-5e4d-a06b-cbb0cd1502ea with scrape type 2
2026-03-28 07:31:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57e69cc5-747c-5e4d-a06b-cbb0cd1502ea, identifier: JX74637
2026-03-28 07:31:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57e69cc5-747c-5e4d-a06b-cbb0cd1502ea with identifier: JX74637
2026-03-28 07:31:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57e69cc5-747c-5e4d-a06b-cbb0cd1502ea with identifier: JX74637
2026-03-28 07:31:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57e69cc5-747c-5e4d-a06b-cbb0cd1502ea with identifier: JX74637 to the API
2026-03-28 07:31:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:39:48Z',
'fuel_type': 'diesel',
'id': '57e69cc5-747c-5e4d-a06b-cbb0cd1502ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX74637',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 231255,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-08-06',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2013}
2026-03-28 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX74637%27 HTTP/1.1" 200 None
2026-03-28 07:31:27 [auto1.de] INFO: Saving data for JX74637: {'auction_closing_time': 1774715988.0, 'created_time': 1774465627.553904, 'last_price_update_time': 1774683087.749406}
2026-03-28 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX74637') HTTP/1.1" 204 0
2026-03-28 07:31:27 [auto1.de] INFO: Found listing with ID: MH26074
2026-03-28 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH26074%27 HTTP/1.1" 200 None
2026-03-28 07:31:27 [auto1.de] INFO: Scrape type for MH26074: 2
2026-03-28 07:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9202ed4c-7be7-566e-9939-81ee5a95fb8c with identifier: MH26074
2026-03-28 07:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9202ed4c-7be7-566e-9939-81ee5a95fb8c with scrape type 2
2026-03-28 07:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9202ed4c-7be7-566e-9939-81ee5a95fb8c with scrape type 2
2026-03-28 07:31:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9202ed4c-7be7-566e-9939-81ee5a95fb8c, identifier: MH26074
2026-03-28 07:31:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9202ed4c-7be7-566e-9939-81ee5a95fb8c with identifier: MH26074
2026-03-28 07:31:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9202ed4c-7be7-566e-9939-81ee5a95fb8c with identifier: MH26074
2026-03-28 07:31:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9202ed4c-7be7-566e-9939-81ee5a95fb8c with identifier: MH26074 to the API
2026-03-28 07:31:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:54:36Z',
'fuel_type': 'petrol',
'id': '9202ed4c-7be7-566e-9939-81ee5a95fb8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH26074',
'listing': 'auction',
'make': 'Seat',
'model': 'Altea',
'odometer': 194744,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-20',
'seller_name': None,
'title': 'Seat Altea 1.4 TSI Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2009}
2026-03-28 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH26074%27 HTTP/1.1" 200 None
2026-03-28 07:31:28 [auto1.de] INFO: Saving data for MH26074: {'auction_closing_time': 1774716876.0, 'created_time': 1774033344.913684, 'last_price_update_time': 1774683088.205122}
2026-03-28 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH26074') HTTP/1.1" 204 0
2026-03-28 07:31:28 [auto1.de] INFO: Found listing with ID: LL99453
2026-03-28 07:31:28 [auto1.de] INFO: Found listing with ID: WK06356
2026-03-28 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK06356%27 HTTP/1.1" 200 None
2026-03-28 07:31:28 [auto1.de] INFO: Scrape type for WK06356: 0
2026-03-28 07:31:28 [auto1.de] INFO: Found listing with ID: LR13115
2026-03-28 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR13115%27 HTTP/1.1" 200 None
2026-03-28 07:31:28 [auto1.de] INFO: Scrape type for LR13115: 2
2026-03-28 07:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7643c86-d9af-55a7-902c-edf2b8204839 with identifier: LR13115
2026-03-28 07:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7643c86-d9af-55a7-902c-edf2b8204839 with scrape type 2
2026-03-28 07:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7643c86-d9af-55a7-902c-edf2b8204839 with scrape type 2
2026-03-28 07:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7643c86-d9af-55a7-902c-edf2b8204839, identifier: LR13115
2026-03-28 07:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7643c86-d9af-55a7-902c-edf2b8204839 with identifier: LR13115
2026-03-28 07:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7643c86-d9af-55a7-902c-edf2b8204839 with identifier: LR13115
2026-03-28 07:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7643c86-d9af-55a7-902c-edf2b8204839 with identifier: LR13115 to the API
2026-03-28 07:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-28T16:47:47Z',
'fuel_type': 'diesel',
'id': 'b7643c86-d9af-55a7-902c-edf2b8204839',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR13115',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 215159,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-26',
'seller_name': None,
'title': 'Audi A4 2.0 TDI quattro Attraction',
'transmission': 'automatic',
'trim': 'quattro Attraction',
'year': 2014}
2026-03-28 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR13115%27 HTTP/1.1" 200 None
2026-03-28 07:31:28 [auto1.de] INFO: Saving data for LR13115: {'auction_closing_time': 1774716467.0, 'created_time': 1774033771.367675, 'last_price_update_time': 1774683088.687104}
2026-03-28 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR13115') HTTP/1.1" 204 0
2026-03-28 07:31:28 [auto1.de] INFO: Found listing with ID: XL27476
2026-03-28 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL27476%27 HTTP/1.1" 200 None
2026-03-28 07:31:28 [auto1.de] INFO: Scrape type for XL27476: 0
2026-03-28 07:31:28 [auto1.de] INFO: Found listing with ID: ZN11262
2026-03-28 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN11262%27 HTTP/1.1" 200 None
2026-03-28 07:31:28 [auto1.de] INFO: Scrape type for ZN11262: 0
2026-03-28 07:31:28 [auto1.de] INFO: Found listing with ID: ZE37210
2026-03-28 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE37210%27 HTTP/1.1" 200 None
2026-03-28 07:31:28 [auto1.de] INFO: Scrape type for ZE37210: 2
2026-03-28 07:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e7c2e2a-1561-596a-9a9a-d17d3b191f30 with identifier: ZE37210
2026-03-28 07:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e7c2e2a-1561-596a-9a9a-d17d3b191f30 with scrape type 2
2026-03-28 07:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e7c2e2a-1561-596a-9a9a-d17d3b191f30 with scrape type 2
2026-03-28 07:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e7c2e2a-1561-596a-9a9a-d17d3b191f30, identifier: ZE37210
2026-03-28 07:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e7c2e2a-1561-596a-9a9a-d17d3b191f30 with identifier: ZE37210
2026-03-28 07:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e7c2e2a-1561-596a-9a9a-d17d3b191f30 with identifier: ZE37210
2026-03-28 07:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e7c2e2a-1561-596a-9a9a-d17d3b191f30 with identifier: ZE37210 to the API
2026-03-28 07:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-28T16:04:30Z',
'fuel_type': 'hybrid',
'id': '7e7c2e2a-1561-596a-9a9a-d17d3b191f30',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE37210',
'listing': 'auction',
'make': 'Cupra',
'model': 'Formentor',
'odometer': 84868,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-28',
'seller_name': None,
'title': 'Cupra Formentor 1.4 e-HYBRID VZ',
'transmission': 'automatic',
'trim': 'VZ',
'year': 2021}
2026-03-28 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE37210%27 HTTP/1.1" 200 None
2026-03-28 07:31:29 [auto1.de] INFO: Saving data for ZE37210: {'auction_closing_time': 1774713870.0, 'created_time': 1774468036.384413, 'last_price_update_time': 1774683089.263499}
2026-03-28 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE37210') HTTP/1.1" 204 0
2026-03-28 07:31:29 [auto1.de] INFO: Found listing with ID: SD08227
2026-03-28 07:31:29 [auto1.de] INFO: Found listing with ID: CN91045
2026-03-28 07:31:29 [auto1.de] INFO: Found listing with ID: XA31743
2026-03-28 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA31743%27 HTTP/1.1" 200 None
2026-03-28 07:31:29 [auto1.de] INFO: Scrape type for XA31743: 0
2026-03-28 07:31:29 [auto1.de] INFO: Found listing with ID: BS93461
2026-03-28 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS93461%27 HTTP/1.1" 200 None
2026-03-28 07:31:29 [auto1.de] INFO: Scrape type for BS93461: 0
2026-03-28 07:31:29 [auto1.de] INFO: Found listing with ID: YH28050
2026-03-28 07:31:29 [auto1.de] INFO: Found listing with ID: EE18812
2026-03-28 07:31:29 [auto1.de] INFO: Found listing with ID: EN73396
2026-03-28 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN73396%27 HTTP/1.1" 200 None
2026-03-28 07:31:29 [auto1.de] INFO: Scrape type for EN73396: 0
2026-03-28 07:31:29 [auto1.de] INFO: Found listing with ID: JA88667
2026-03-28 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA88667%27 HTTP/1.1" 200 None
2026-03-28 07:31:29 [auto1.de] INFO: Scrape type for JA88667: 0
2026-03-28 07:31:29 [auto1.de] INFO: Found listing with ID: NL93561
2026-03-28 07:31:29 [auto1.de] INFO: Found listing with ID: LX13795
2026-03-28 07:31:29 [auto1.de] INFO: Found listing with ID: XA47491
2026-03-28 07:31:29 [auto1.de] INFO: Found listing with ID: ZJ17739
2026-03-28 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ17739%27 HTTP/1.1" 200 None
2026-03-28 07:31:29 [auto1.de] INFO: Scrape type for ZJ17739: 0
2026-03-28 07:31:29 [auto1.de] INFO: Found listing with ID: KL79977
2026-03-28 07:31:29 [auto1.de] INFO: Found listing with ID: VL10469
2026-03-28 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL10469%27 HTTP/1.1" 200 None
2026-03-28 07:31:29 [auto1.de] INFO: Scrape type for VL10469: 2
2026-03-28 07:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7702ab85-2490-5d21-b91a-9e0c8e5883bf with identifier: VL10469
2026-03-28 07:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7702ab85-2490-5d21-b91a-9e0c8e5883bf with scrape type 2
2026-03-28 07:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7702ab85-2490-5d21-b91a-9e0c8e5883bf with scrape type 2
2026-03-28 07:31:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7702ab85-2490-5d21-b91a-9e0c8e5883bf, identifier: VL10469
2026-03-28 07:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7702ab85-2490-5d21-b91a-9e0c8e5883bf with identifier: VL10469
2026-03-28 07:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7702ab85-2490-5d21-b91a-9e0c8e5883bf with identifier: VL10469
2026-03-28 07:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7702ab85-2490-5d21-b91a-9e0c8e5883bf with identifier: VL10469 to the API
2026-03-28 07:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:37:43Z',
'fuel_type': 'diesel',
'id': '7702ab85-2490-5d21-b91a-9e0c8e5883bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL10469',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'V-Klasse',
'odometer': 164882,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-07',
'seller_name': None,
'title': 'Mercedes-Benz V-Klasse V 250 d lang BlueTEC Edition',
'transmission': 'automatic',
'trim': 'lang BlueTEC Edition',
'year': 2014}
2026-03-28 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL10469%27 HTTP/1.1" 200 None
2026-03-28 07:31:29 [auto1.de] INFO: Saving data for VL10469: {'auction_closing_time': 1774715863.0, 'created_time': 1774466315.186218, 'last_price_update_time': 1774683089.828616}
2026-03-28 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL10469') HTTP/1.1" 204 0
2026-03-28 07:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:31:30 [auto1.de] INFO: Channel: 24h | Page: 17 | totalHits: 9248 | hits on page: 40
2026-03-28 07:31:30 [auto1.de] INFO: Found listing with ID: WZ55342
2026-03-28 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ55342%27 HTTP/1.1" 200 None
2026-03-28 07:31:30 [auto1.de] INFO: Scrape type for WZ55342: 2
2026-03-28 07:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c61ff8a3-79dc-5ade-b801-8dc5b065f52e with identifier: WZ55342
2026-03-28 07:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c61ff8a3-79dc-5ade-b801-8dc5b065f52e with scrape type 2
2026-03-28 07:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c61ff8a3-79dc-5ade-b801-8dc5b065f52e with scrape type 2
2026-03-28 07:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c61ff8a3-79dc-5ade-b801-8dc5b065f52e, identifier: WZ55342
2026-03-28 07:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c61ff8a3-79dc-5ade-b801-8dc5b065f52e with identifier: WZ55342
2026-03-28 07:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c61ff8a3-79dc-5ade-b801-8dc5b065f52e with identifier: WZ55342
2026-03-28 07:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c61ff8a3-79dc-5ade-b801-8dc5b065f52e with identifier: WZ55342 to the API
2026-03-28 07:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:39:46Z',
'fuel_type': 'diesel',
'id': 'c61ff8a3-79dc-5ade-b801-8dc5b065f52e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ55342',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'V-Klasse',
'odometer': 145838,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-16',
'seller_name': None,
'title': 'Mercedes-Benz V-Klasse V 220 d lang Rise',
'transmission': 'automatic',
'trim': 'lang Rise',
'year': 2018}
2026-03-28 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ55342%27 HTTP/1.1" 200 None
2026-03-28 07:31:30 [auto1.de] INFO: Saving data for WZ55342: {'auction_closing_time': 1774715986.0, 'created_time': 1774466455.647817, 'last_price_update_time': 1774683090.57805}
2026-03-28 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ55342') HTTP/1.1" 204 0
2026-03-28 07:31:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:31:30 [auto1.de] INFO: Found listing with ID: NS09930
2026-03-28 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS09930%27 HTTP/1.1" 200 None
2026-03-28 07:31:30 [auto1.de] INFO: Scrape type for NS09930: 0
2026-03-28 07:31:30 [auto1.de] INFO: Found listing with ID: SC00063
2026-03-28 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC00063%27 HTTP/1.1" 200 None
2026-03-28 07:31:30 [auto1.de] INFO: Scrape type for SC00063: 0
2026-03-28 07:31:30 [auto1.de] INFO: Found listing with ID: GM93561
2026-03-28 07:31:30 [auto1.de] INFO: Found listing with ID: XX63179
2026-03-28 07:31:30 [auto1.de] INFO: Found listing with ID: NJ70051
2026-03-28 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ70051%27 HTTP/1.1" 200 None
2026-03-28 07:31:30 [auto1.de] INFO: Scrape type for NJ70051: 0
2026-03-28 07:31:30 [auto1.de] INFO: Found listing with ID: YJ74621
2026-03-28 07:31:30 [auto1.de] INFO: Found listing with ID: XY04556
2026-03-28 07:31:30 [auto1.de] INFO: Found listing with ID: GN33962
2026-03-28 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN33962%27 HTTP/1.1" 200 None
2026-03-28 07:31:30 [auto1.de] INFO: Scrape type for GN33962: 2
2026-03-28 07:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 207ab416-6b4a-598a-81d6-40c07f55ec47 with identifier: GN33962
2026-03-28 07:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 207ab416-6b4a-598a-81d6-40c07f55ec47 with scrape type 2
2026-03-28 07:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 207ab416-6b4a-598a-81d6-40c07f55ec47 with scrape type 2
2026-03-28 07:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 207ab416-6b4a-598a-81d6-40c07f55ec47, identifier: GN33962
2026-03-28 07:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 207ab416-6b4a-598a-81d6-40c07f55ec47 with identifier: GN33962
2026-03-28 07:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 207ab416-6b4a-598a-81d6-40c07f55ec47 with identifier: GN33962
2026-03-28 07:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 207ab416-6b4a-598a-81d6-40c07f55ec47 with identifier: GN33962 to the API
2026-03-28 07:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-28T16:20:04Z',
'fuel_type': 'petrol',
'id': '207ab416-6b4a-598a-81d6-40c07f55ec47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN33962',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Cross',
'odometer': 25246,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-06-19',
'seller_name': None,
'title': 'Volkswagen T-Cross 1.0 TSI Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2024}
2026-03-28 07:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN33962%27 HTTP/1.1" 200 None
2026-03-28 07:31:31 [auto1.de] INFO: Saving data for GN33962: {'auction_closing_time': 1774714804.0, 'created_time': 1774466297.685721, 'last_price_update_time': 1774683091.217307}
2026-03-28 07:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN33962') HTTP/1.1" 204 0
2026-03-28 07:31:31 [auto1.de] INFO: Found listing with ID: CH37782
2026-03-28 07:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH37782%27 HTTP/1.1" 200 None
2026-03-28 07:31:31 [auto1.de] INFO: Scrape type for CH37782: 2
2026-03-28 07:31:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03076242-cfb5-582b-8cbe-911f55cdebcd with identifier: CH37782
2026-03-28 07:31:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03076242-cfb5-582b-8cbe-911f55cdebcd with scrape type 2
2026-03-28 07:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03076242-cfb5-582b-8cbe-911f55cdebcd with scrape type 2
2026-03-28 07:31:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03076242-cfb5-582b-8cbe-911f55cdebcd, identifier: CH37782
2026-03-28 07:31:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03076242-cfb5-582b-8cbe-911f55cdebcd with identifier: CH37782
2026-03-28 07:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:31:31 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 07:31:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:31:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03076242-cfb5-582b-8cbe-911f55cdebcd with identifier: CH37782
2026-03-28 07:31:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03076242-cfb5-582b-8cbe-911f55cdebcd with identifier: CH37782 to the API
2026-03-28 07:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-28T16:25:25Z',
'fuel_type': 'petrol',
'id': '03076242-cfb5-582b-8cbe-911f55cdebcd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH37782',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 90741,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-09-16',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 140 Classic',
'transmission': 'automatic',
'trim': 'Classic',
'year': 2001}
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH37782%27 HTTP/1.1" 200 None
2026-03-28 07:31:32 [auto1.de] INFO: Saving data for CH37782: {'auction_closing_time': 1774715125.0, 'created_time': 1774465857.678552, 'last_price_update_time': 1774683092.072615}
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH37782') HTTP/1.1" 204 0
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: JX09791
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: TH10598
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH10598%27 HTTP/1.1" 200 None
2026-03-28 07:31:32 [auto1.de] INFO: Scrape type for TH10598: 0
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: KE28324
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: SW57264
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: CF84548
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF84548%27 HTTP/1.1" 200 None
2026-03-28 07:31:32 [auto1.de] INFO: Scrape type for CF84548: 0
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: WC60331
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: WP53621
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: AL02035
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL02035%27 HTTP/1.1" 200 None
2026-03-28 07:31:32 [auto1.de] INFO: Scrape type for AL02035: 0
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: UL11229
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL11229%27 HTTP/1.1" 200 None
2026-03-28 07:31:32 [auto1.de] INFO: Scrape type for UL11229: 0
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: VY54552
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY54552%27 HTTP/1.1" 200 None
2026-03-28 07:31:32 [auto1.de] INFO: Scrape type for VY54552: 0
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: UP80986
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: YT12471
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: ZB74366
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB74366%27 HTTP/1.1" 200 None
2026-03-28 07:31:32 [auto1.de] INFO: Scrape type for ZB74366: 0
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: TD17986
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD17986%27 HTTP/1.1" 200 None
2026-03-28 07:31:32 [auto1.de] INFO: Scrape type for TD17986: 0
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: KJ32312
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ32312%27 HTTP/1.1" 200 None
2026-03-28 07:31:32 [auto1.de] INFO: Scrape type for KJ32312: 0
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: UJ67578
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: XP92221
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: BT20350
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT20350%27 HTTP/1.1" 200 None
2026-03-28 07:31:32 [auto1.de] INFO: Scrape type for BT20350: 0
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: LN92590
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: NH67676
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH67676%27 HTTP/1.1" 200 None
2026-03-28 07:31:32 [auto1.de] INFO: Scrape type for NH67676: 0
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: TV15766
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV15766%27 HTTP/1.1" 200 None
2026-03-28 07:31:32 [auto1.de] INFO: Scrape type for TV15766: 2
2026-03-28 07:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f17d7d5e-c18b-58f8-b3f2-76b7821da5ad with identifier: TV15766
2026-03-28 07:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f17d7d5e-c18b-58f8-b3f2-76b7821da5ad with scrape type 2
2026-03-28 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f17d7d5e-c18b-58f8-b3f2-76b7821da5ad with scrape type 2
2026-03-28 07:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f17d7d5e-c18b-58f8-b3f2-76b7821da5ad, identifier: TV15766
2026-03-28 07:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f17d7d5e-c18b-58f8-b3f2-76b7821da5ad with identifier: TV15766
2026-03-28 07:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f17d7d5e-c18b-58f8-b3f2-76b7821da5ad with identifier: TV15766
2026-03-28 07:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f17d7d5e-c18b-58f8-b3f2-76b7821da5ad with identifier: TV15766 to the API
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:23:16Z',
'fuel_type': 'petrol',
'id': 'f17d7d5e-c18b-58f8-b3f2-76b7821da5ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV15766',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 229204,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-31',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.4 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2011}
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV15766%27 HTTP/1.1" 200 None
2026-03-28 07:31:32 [auto1.de] INFO: Saving data for TV15766: {'auction_closing_time': 1774714996.0, 'created_time': 1774466739.62391, 'last_price_update_time': 1774683092.676004}
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV15766') HTTP/1.1" 204 0
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: KS07911
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: UY72197
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: JT25631
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT25631%27 HTTP/1.1" 200 None
2026-03-28 07:31:32 [auto1.de] INFO: Scrape type for JT25631: 0
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: FD74109
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD74109%27 HTTP/1.1" 200 None
2026-03-28 07:31:32 [auto1.de] INFO: Scrape type for FD74109: 0
2026-03-28 07:31:32 [auto1.de] INFO: Found listing with ID: VT28358
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT28358%27 HTTP/1.1" 200 None
2026-03-28 07:31:32 [auto1.de] INFO: Scrape type for VT28358: 2
2026-03-28 07:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df44666b-d88e-5c67-8401-8ea053a4194c with identifier: VT28358
2026-03-28 07:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df44666b-d88e-5c67-8401-8ea053a4194c with scrape type 2
2026-03-28 07:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df44666b-d88e-5c67-8401-8ea053a4194c with scrape type 2
2026-03-28 07:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df44666b-d88e-5c67-8401-8ea053a4194c, identifier: VT28358
2026-03-28 07:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df44666b-d88e-5c67-8401-8ea053a4194c with identifier: VT28358
2026-03-28 07:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df44666b-d88e-5c67-8401-8ea053a4194c with identifier: VT28358
2026-03-28 07:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df44666b-d88e-5c67-8401-8ea053a4194c with identifier: VT28358 to the API
2026-03-28 07:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 91,
'expiration_date': '2026-03-28T16:21:29Z',
'fuel_type': 'petrol',
'id': 'df44666b-d88e-5c67-8401-8ea053a4194c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT28358',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 19051,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-22',
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe Stepway Expression',
'transmission': 'automatic',
'trim': 'Stepway Expression',
'year': 2023}
2026-03-28 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT28358%27 HTTP/1.1" 200 None
2026-03-28 07:31:33 [auto1.de] INFO: Saving data for VT28358: {'auction_closing_time': 1774714889.0, 'created_time': 1774467643.342953, 'last_price_update_time': 1774683093.233785}
2026-03-28 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT28358') HTTP/1.1" 204 0
2026-03-28 07:31:33 [auto1.de] INFO: Found listing with ID: BY14776
2026-03-28 07:31:33 [auto1.de] INFO: Found listing with ID: BH50029
2026-03-28 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH50029%27 HTTP/1.1" 200 None
2026-03-28 07:31:33 [auto1.de] INFO: Scrape type for BH50029: 0
2026-03-28 07:31:33 [auto1.de] INFO: Found listing with ID: LC33794
2026-03-28 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC33794%27 HTTP/1.1" 200 None
2026-03-28 07:31:33 [auto1.de] INFO: Scrape type for LC33794: 0
2026-03-28 07:31:33 [auto1.de] INFO: Found listing with ID: FG40376
2026-03-28 07:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:32:04 [auto1.de] INFO: Channel: 24h | Page: 18 | totalHits: 9249 | hits on page: 40
2026-03-28 07:32:04 [auto1.de] INFO: Found listing with ID: FG40376
2026-03-28 07:32:04 [auto1.de] INFO: Found listing with ID: LU76842
2026-03-28 07:32:04 [auto1.de] INFO: Found listing with ID: JA95391
2026-03-28 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA95391%27 HTTP/1.1" 200 None
2026-03-28 07:32:04 [auto1.de] INFO: Scrape type for JA95391: 0
2026-03-28 07:32:04 [auto1.de] INFO: Found listing with ID: DF25786
2026-03-28 07:32:04 [auto1.de] INFO: Found listing with ID: RL14403
2026-03-28 07:32:04 [auto1.de] INFO: Found listing with ID: CP27370
2026-03-28 07:32:04 [auto1.de] INFO: Found listing with ID: PU08613
2026-03-28 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU08613%27 HTTP/1.1" 200 None
2026-03-28 07:32:04 [auto1.de] INFO: Scrape type for PU08613: 0
2026-03-28 07:32:04 [auto1.de] INFO: Found listing with ID: VM29679
2026-03-28 07:32:04 [auto1.de] INFO: Found listing with ID: DS79921
2026-03-28 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS79921%27 HTTP/1.1" 200 None
2026-03-28 07:32:04 [auto1.de] INFO: Scrape type for DS79921: 0
2026-03-28 07:32:04 [auto1.de] INFO: Found listing with ID: YM33158
2026-03-28 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM33158%27 HTTP/1.1" 200 None
2026-03-28 07:32:04 [auto1.de] INFO: Scrape type for YM33158: 2
2026-03-28 07:32:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ef07434-4b66-5b4e-b99a-e0bcfd58a459 with identifier: YM33158
2026-03-28 07:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ef07434-4b66-5b4e-b99a-e0bcfd58a459 with scrape type 2
2026-03-28 07:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ef07434-4b66-5b4e-b99a-e0bcfd58a459 with scrape type 2
2026-03-28 07:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ef07434-4b66-5b4e-b99a-e0bcfd58a459, identifier: YM33158
2026-03-28 07:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ef07434-4b66-5b4e-b99a-e0bcfd58a459 with identifier: YM33158
2026-03-28 07:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ef07434-4b66-5b4e-b99a-e0bcfd58a459 with identifier: YM33158
2026-03-28 07:32:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ef07434-4b66-5b4e-b99a-e0bcfd58a459 with identifier: YM33158 to the API
2026-03-28 07:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:44:11Z',
'fuel_type': 'diesel',
'id': '6ef07434-4b66-5b4e-b99a-e0bcfd58a459',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM33158',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit Custom',
'odometer': 30492,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-28',
'seller_name': None,
'title': 'Ford Transit Custom 2.0 TDCi 320 L2 Trend',
'transmission': 'manual',
'trim': '320 L2 Trend',
'year': 2018}
2026-03-28 07:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM33158%27 HTTP/1.1" 200 None
2026-03-28 07:32:05 [auto1.de] INFO: Saving data for YM33158: {'auction_closing_time': 1774716251.0, 'created_time': 1774466944.340034, 'last_price_update_time': 1774683125.386904}
2026-03-28 07:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM33158') HTTP/1.1" 204 0
2026-03-28 07:32:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:32:05 [auto1.de] INFO: Found listing with ID: MA12811
2026-03-28 07:32:05 [auto1.de] INFO: Found listing with ID: JZ03470
2026-03-28 07:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ03470%27 HTTP/1.1" 200 None
2026-03-28 07:32:05 [auto1.de] INFO: Scrape type for JZ03470: 2
2026-03-28 07:32:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4395b6e2-72d1-591d-bbc6-642503b10244 with identifier: JZ03470
2026-03-28 07:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4395b6e2-72d1-591d-bbc6-642503b10244 with scrape type 2
2026-03-28 07:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4395b6e2-72d1-591d-bbc6-642503b10244 with scrape type 2
2026-03-28 07:32:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4395b6e2-72d1-591d-bbc6-642503b10244, identifier: JZ03470
2026-03-28 07:32:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4395b6e2-72d1-591d-bbc6-642503b10244 with identifier: JZ03470
2026-03-28 07:32:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4395b6e2-72d1-591d-bbc6-642503b10244 with identifier: JZ03470
2026-03-28 07:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4395b6e2-72d1-591d-bbc6-642503b10244 with identifier: JZ03470 to the API
2026-03-28 07:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 98,
'expiration_date': '2026-03-28T16:46:05Z',
'fuel_type': 'petrol',
'id': '4395b6e2-72d1-591d-bbc6-642503b10244',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ03470',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 127580,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-27',
'seller_name': None,
'title': 'MINI One',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-28 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ03470%27 HTTP/1.1" 200 None
2026-03-28 07:32:06 [auto1.de] INFO: Saving data for JZ03470: {'auction_closing_time': 1774716365.0, 'created_time': 1774031808.069651, 'last_price_update_time': 1774683126.479195}
2026-03-28 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ03470') HTTP/1.1" 204 0
2026-03-28 07:32:06 [auto1.de] INFO: Found listing with ID: YV00461
2026-03-28 07:32:06 [auto1.de] INFO: Found listing with ID: RP49857
2026-03-28 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP49857%27 HTTP/1.1" 200 None
2026-03-28 07:32:06 [auto1.de] INFO: Scrape type for RP49857: 0
2026-03-28 07:32:06 [auto1.de] INFO: Found listing with ID: WR52929
2026-03-28 07:32:06 [auto1.de] INFO: Found listing with ID: UM76329
2026-03-28 07:32:06 [auto1.de] INFO: Found listing with ID: PE28100
2026-03-28 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE28100%27 HTTP/1.1" 200 None
2026-03-28 07:32:06 [auto1.de] INFO: Scrape type for PE28100: 0
2026-03-28 07:32:06 [auto1.de] INFO: Found listing with ID: EB81332
2026-03-28 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB81332%27 HTTP/1.1" 200 None
2026-03-28 07:32:06 [auto1.de] INFO: Scrape type for EB81332: 0
2026-03-28 07:32:06 [auto1.de] INFO: Found listing with ID: VC21534
2026-03-28 07:32:06 [auto1.de] INFO: Found listing with ID: MA20018
2026-03-28 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA20018%27 HTTP/1.1" 200 None
2026-03-28 07:32:06 [auto1.de] INFO: Scrape type for MA20018: 0
2026-03-28 07:32:06 [auto1.de] INFO: Found listing with ID: RE36292
2026-03-28 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE36292%27 HTTP/1.1" 200 None
2026-03-28 07:32:06 [auto1.de] INFO: Scrape type for RE36292: 0
2026-03-28 07:32:06 [auto1.de] INFO: Found listing with ID: CM07244
2026-03-28 07:32:06 [auto1.de] INFO: Found listing with ID: FT76728
2026-03-28 07:32:06 [auto1.de] INFO: Found listing with ID: ES78783
2026-03-28 07:32:06 [auto1.de] INFO: Found listing with ID: ZY80626
2026-03-28 07:32:06 [auto1.de] INFO: Found listing with ID: SZ29379
2026-03-28 07:32:06 [auto1.de] INFO: Found listing with ID: LK88331
2026-03-28 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK88331%27 HTTP/1.1" 200 None
2026-03-28 07:32:06 [auto1.de] INFO: Scrape type for LK88331: 0
2026-03-28 07:32:06 [auto1.de] INFO: Found listing with ID: JG57844
2026-03-28 07:32:06 [auto1.de] INFO: Found listing with ID: WR65399
2026-03-28 07:32:06 [auto1.de] INFO: Found listing with ID: MH95241
2026-03-28 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH95241%27 HTTP/1.1" 200 None
2026-03-28 07:32:06 [auto1.de] INFO: Scrape type for MH95241: 2
2026-03-28 07:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db40ae05-9798-505c-abc8-b36a419d1cda with identifier: MH95241
2026-03-28 07:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db40ae05-9798-505c-abc8-b36a419d1cda with scrape type 2
2026-03-28 07:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db40ae05-9798-505c-abc8-b36a419d1cda with scrape type 2
2026-03-28 07:32:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db40ae05-9798-505c-abc8-b36a419d1cda, identifier: MH95241
2026-03-28 07:32:06 [scrapy.extensions.logstats] INFO: Crawled 24 pages (at 10 pages/min), scraped 69 items (at 30 items/min)
2026-03-28 07:32:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 165MiB
2026-03-28 07:32:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db40ae05-9798-505c-abc8-b36a419d1cda with identifier: MH95241
2026-03-28 07:32:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db40ae05-9798-505c-abc8-b36a419d1cda with identifier: MH95241
2026-03-28 07:32:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db40ae05-9798-505c-abc8-b36a419d1cda with identifier: MH95241 to the API
2026-03-28 07:32:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-28T16:13:32Z',
'fuel_type': 'petrol',
'id': 'db40ae05-9798-505c-abc8-b36a419d1cda',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH95241',
'listing': 'auction',
'make': 'Kia',
'model': 'XCeed',
'odometer': 42856,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-13',
'seller_name': None,
'title': 'Kia XCeed 1.5 TGDI Edition 7',
'transmission': 'manual',
'trim': 'Edition 7',
'year': 2022}
2026-03-28 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH95241%27 HTTP/1.1" 200 None
2026-03-28 07:32:07 [auto1.de] INFO: Saving data for MH95241: {'auction_closing_time': 1774714412.0, 'created_time': 1774463624.809781, 'last_price_update_time': 1774683127.044284}
2026-03-28 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH95241') HTTP/1.1" 204 0
2026-03-28 07:32:07 [auto1.de] INFO: Found listing with ID: MJ83876
2026-03-28 07:32:07 [auto1.de] INFO: Found listing with ID: DX81242
2026-03-28 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX81242%27 HTTP/1.1" 200 None
2026-03-28 07:32:07 [auto1.de] INFO: Scrape type for DX81242: 0
2026-03-28 07:32:07 [auto1.de] INFO: Found listing with ID: MF03650
2026-03-28 07:32:07 [auto1.de] INFO: Found listing with ID: XG52732
2026-03-28 07:32:07 [auto1.de] INFO: Found listing with ID: DE69503
2026-03-28 07:32:07 [auto1.de] INFO: Found listing with ID: SE45637
2026-03-28 07:32:07 [auto1.de] INFO: Found listing with ID: CW35231
2026-03-28 07:32:07 [auto1.de] INFO: Found listing with ID: JP43917
2026-03-28 07:32:07 [auto1.de] INFO: Found listing with ID: UT80766
2026-03-28 07:32:07 [auto1.de] INFO: Found listing with ID: MP12786
2026-03-28 07:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:32:08 [auto1.de] INFO: Channel: 24h | Page: 19 | totalHits: 9249 | hits on page: 40
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: PG06608
2026-03-28 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG06608%27 HTTP/1.1" 200 None
2026-03-28 07:32:08 [auto1.de] INFO: Scrape type for PG06608: 0
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: BA53965
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: BM06383
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: HJ07036
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: XL53582
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: CC01881
2026-03-28 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC01881%27 HTTP/1.1" 200 None
2026-03-28 07:32:08 [auto1.de] INFO: Scrape type for CC01881: 0
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: VA45757
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: DH52741
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: LS93174
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: UM55631
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: BG43270
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: US98158
2026-03-28 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US98158%27 HTTP/1.1" 200 None
2026-03-28 07:32:08 [auto1.de] INFO: Scrape type for US98158: 0
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: SE09507
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: XZ97961
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: AZ98687
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: MX80513
2026-03-28 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX80513%27 HTTP/1.1" 200 None
2026-03-28 07:32:08 [auto1.de] INFO: Scrape type for MX80513: 0
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: HY91019
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: SP10962
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: DL48053
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: MH16408
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: XW43121
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: WL40040
2026-03-28 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL40040%27 HTTP/1.1" 200 None
2026-03-28 07:32:08 [auto1.de] INFO: Scrape type for WL40040: 0
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: WN08657
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: WJ49334
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: MR38870
2026-03-28 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR38870%27 HTTP/1.1" 200 None
2026-03-28 07:32:08 [auto1.de] INFO: Scrape type for MR38870: 0
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: CX66529
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: KA23374
2026-03-28 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA23374%27 HTTP/1.1" 200 None
2026-03-28 07:32:08 [auto1.de] INFO: Scrape type for KA23374: 2
2026-03-28 07:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9917032-e6c1-5bc2-8aeb-bad3c801ec57 with identifier: KA23374
2026-03-28 07:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9917032-e6c1-5bc2-8aeb-bad3c801ec57 with scrape type 2
2026-03-28 07:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9917032-e6c1-5bc2-8aeb-bad3c801ec57 with scrape type 2
2026-03-28 07:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9917032-e6c1-5bc2-8aeb-bad3c801ec57, identifier: KA23374
2026-03-28 07:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9917032-e6c1-5bc2-8aeb-bad3c801ec57 with identifier: KA23374
2026-03-28 07:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9917032-e6c1-5bc2-8aeb-bad3c801ec57 with identifier: KA23374
2026-03-28 07:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9917032-e6c1-5bc2-8aeb-bad3c801ec57 with identifier: KA23374 to the API
2026-03-28 07:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:39:41Z',
'fuel_type': 'petrol',
'id': 'f9917032-e6c1-5bc2-8aeb-bad3c801ec57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA23374',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 68717,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-03',
'seller_name': None,
'title': 'Volkswagen Passat 1.5 TSI ACT Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2021}
2026-03-28 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA23374%27 HTTP/1.1" 200 None
2026-03-28 07:32:08 [auto1.de] INFO: Saving data for KA23374: {'auction_closing_time': 1774715981.0, 'created_time': 1774466315.763086, 'last_price_update_time': 1774683128.761601}
2026-03-28 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA23374') HTTP/1.1" 204 0
2026-03-28 07:32:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:32:08 [auto1.de] INFO: Found listing with ID: NR02271
2026-03-28 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR02271%27 HTTP/1.1" 200 None
2026-03-28 07:32:08 [auto1.de] INFO: Scrape type for NR02271: 2
2026-03-28 07:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e4cc439-5648-58cf-a82e-cd0d01e672b2 with identifier: NR02271
2026-03-28 07:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e4cc439-5648-58cf-a82e-cd0d01e672b2 with scrape type 2
2026-03-28 07:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e4cc439-5648-58cf-a82e-cd0d01e672b2 with scrape type 2
2026-03-28 07:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e4cc439-5648-58cf-a82e-cd0d01e672b2, identifier: NR02271
2026-03-28 07:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e4cc439-5648-58cf-a82e-cd0d01e672b2 with identifier: NR02271
2026-03-28 07:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e4cc439-5648-58cf-a82e-cd0d01e672b2 with identifier: NR02271
2026-03-28 07:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e4cc439-5648-58cf-a82e-cd0d01e672b2 with identifier: NR02271 to the API
2026-03-28 07:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:03:03Z',
'fuel_type': 'petrol',
'id': '7e4cc439-5648-58cf-a82e-cd0d01e672b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR02271',
'listing': 'auction',
'make': 'Ford',
'model': 'Fusion',
'odometer': 188524,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-11-16',
'seller_name': None,
'title': 'Ford Fusion 1.6 Plus',
'transmission': 'manual',
'trim': 'Plus',
'year': 2005}
2026-03-28 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR02271%27 HTTP/1.1" 200 None
2026-03-28 07:32:09 [auto1.de] INFO: Saving data for NR02271: {'auction_closing_time': 1774713783.0, 'created_time': 1774468078.755804, 'last_price_update_time': 1774683129.292718}
2026-03-28 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR02271') HTTP/1.1" 204 0
2026-03-28 07:32:09 [auto1.de] INFO: Found listing with ID: ZC85664
2026-03-28 07:32:09 [auto1.de] INFO: Found listing with ID: DJ88162
2026-03-28 07:32:09 [auto1.de] INFO: Found listing with ID: BY78150
2026-03-28 07:32:09 [auto1.de] INFO: Found listing with ID: KT69264
2026-03-28 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT69264%27 HTTP/1.1" 200 None
2026-03-28 07:32:09 [auto1.de] INFO: Scrape type for KT69264: 2
2026-03-28 07:32:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bdefeec-12f6-5bc5-a67e-1582aeca2902 with identifier: KT69264
2026-03-28 07:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bdefeec-12f6-5bc5-a67e-1582aeca2902 with scrape type 2
2026-03-28 07:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bdefeec-12f6-5bc5-a67e-1582aeca2902 with scrape type 2
2026-03-28 07:32:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bdefeec-12f6-5bc5-a67e-1582aeca2902, identifier: KT69264
2026-03-28 07:32:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bdefeec-12f6-5bc5-a67e-1582aeca2902 with identifier: KT69264
2026-03-28 07:32:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bdefeec-12f6-5bc5-a67e-1582aeca2902 with identifier: KT69264
2026-03-28 07:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bdefeec-12f6-5bc5-a67e-1582aeca2902 with identifier: KT69264 to the API
2026-03-28 07:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:12:42Z',
'fuel_type': 'petrol',
'id': '3bdefeec-12f6-5bc5-a67e-1582aeca2902',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT69264',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 69659,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-18',
'seller_name': None,
'title': 'Ford Fiesta 1.0 EcoBoost Vignale',
'transmission': 'manual',
'trim': 'Vignale',
'year': 2017}
2026-03-28 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT69264%27 HTTP/1.1" 200 None
2026-03-28 07:32:09 [auto1.de] INFO: Saving data for KT69264: {'auction_closing_time': 1774714362.0, 'created_time': 1774467986.979616, 'last_price_update_time': 1774683129.742294}
2026-03-28 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT69264') HTTP/1.1" 204 0
2026-03-28 07:32:09 [auto1.de] INFO: Found listing with ID: LJ58036
2026-03-28 07:32:09 [auto1.de] INFO: Found listing with ID: GZ46428
2026-03-28 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ46428%27 HTTP/1.1" 200 None
2026-03-28 07:32:09 [auto1.de] INFO: Scrape type for GZ46428: 0
2026-03-28 07:32:09 [auto1.de] INFO: Found listing with ID: HK34206
2026-03-28 07:32:09 [auto1.de] INFO: Found listing with ID: VS79881
2026-03-28 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS79881%27 HTTP/1.1" 200 None
2026-03-28 07:32:09 [auto1.de] INFO: Scrape type for VS79881: 0
2026-03-28 07:32:09 [auto1.de] INFO: Found listing with ID: VU46856
2026-03-28 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU46856%27 HTTP/1.1" 200 None
2026-03-28 07:32:09 [auto1.de] INFO: Scrape type for VU46856: 0
2026-03-28 07:32:09 [auto1.de] INFO: Found listing with ID: YH17193
2026-03-28 07:32:09 [auto1.de] INFO: Found listing with ID: BU83638
2026-03-28 07:32:09 [auto1.de] INFO: Found listing with ID: EN93789
2026-03-28 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN93789%27 HTTP/1.1" 200 None
2026-03-28 07:32:09 [auto1.de] INFO: Scrape type for EN93789: 0
2026-03-28 07:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:32:10 [auto1.de] INFO: Channel: 24h | Page: 20 | totalHits: 9249 | hits on page: 40
2026-03-28 07:32:10 [auto1.de] INFO: Found listing with ID: HR39540
2026-03-28 07:32:10 [auto1.de] INFO: Found listing with ID: RS35479
2026-03-28 07:32:10 [auto1.de] INFO: Found listing with ID: EW47494
2026-03-28 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW47494%27 HTTP/1.1" 200 None
2026-03-28 07:32:10 [auto1.de] INFO: Scrape type for EW47494: 2
2026-03-28 07:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0254ced-9dd2-5ce9-b53b-ad62a87b550a with identifier: EW47494
2026-03-28 07:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0254ced-9dd2-5ce9-b53b-ad62a87b550a with scrape type 2
2026-03-28 07:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0254ced-9dd2-5ce9-b53b-ad62a87b550a with scrape type 2
2026-03-28 07:32:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0254ced-9dd2-5ce9-b53b-ad62a87b550a, identifier: EW47494
2026-03-28 07:32:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0254ced-9dd2-5ce9-b53b-ad62a87b550a with identifier: EW47494
2026-03-28 07:32:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0254ced-9dd2-5ce9-b53b-ad62a87b550a with identifier: EW47494
2026-03-28 07:32:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0254ced-9dd2-5ce9-b53b-ad62a87b550a with identifier: EW47494 to the API
2026-03-28 07:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-28T16:50:06Z',
'fuel_type': 'petrol',
'id': 'c0254ced-9dd2-5ce9-b53b-ad62a87b550a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW47494',
'listing': 'auction',
'make': 'Opel',
'model': 'Signum',
'odometer': 129008,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-07-20',
'seller_name': None,
'title': 'Opel Signum 2.2 Edition',
'transmission': 'automatic',
'trim': 'Edition',
'year': 2005}
2026-03-28 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW47494%27 HTTP/1.1" 200 None
2026-03-28 07:32:11 [auto1.de] INFO: Saving data for EW47494: {'auction_closing_time': 1774716606.0, 'created_time': 1773773421.528833, 'last_price_update_time': 1774683131.209202}
2026-03-28 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW47494') HTTP/1.1" 204 0
2026-03-28 07:32:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:32:11 [auto1.de] INFO: Found listing with ID: JB50627
2026-03-28 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB50627%27 HTTP/1.1" 200 None
2026-03-28 07:32:11 [auto1.de] INFO: Scrape type for JB50627: 0
2026-03-28 07:32:11 [auto1.de] INFO: Found listing with ID: WS51511
2026-03-28 07:32:11 [auto1.de] INFO: Found listing with ID: WC43161
2026-03-28 07:32:11 [auto1.de] INFO: Found listing with ID: YM50991
2026-03-28 07:32:11 [auto1.de] INFO: Found listing with ID: TS98939
2026-03-28 07:32:11 [auto1.de] INFO: Found listing with ID: JG32595
2026-03-28 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG32595%27 HTTP/1.1" 200 None
2026-03-28 07:32:11 [auto1.de] INFO: Scrape type for JG32595: 2
2026-03-28 07:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d36662b-d76e-5d06-8bcb-ee9c8b51798f with identifier: JG32595
2026-03-28 07:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d36662b-d76e-5d06-8bcb-ee9c8b51798f with scrape type 2
2026-03-28 07:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d36662b-d76e-5d06-8bcb-ee9c8b51798f with scrape type 2
2026-03-28 07:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d36662b-d76e-5d06-8bcb-ee9c8b51798f, identifier: JG32595
2026-03-28 07:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d36662b-d76e-5d06-8bcb-ee9c8b51798f with identifier: JG32595
2026-03-28 07:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d36662b-d76e-5d06-8bcb-ee9c8b51798f with identifier: JG32595
2026-03-28 07:32:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d36662b-d76e-5d06-8bcb-ee9c8b51798f with identifier: JG32595 to the API
2026-03-28 07:32:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 82,
'expiration_date': '2026-03-28T16:18:44Z',
'fuel_type': 'petrol',
'id': '5d36662b-d76e-5d06-8bcb-ee9c8b51798f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG32595',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 151778,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-12-17',
'seller_name': None,
'title': 'Ford Fiesta 1.25 Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2008}
2026-03-28 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG32595%27 HTTP/1.1" 200 None
2026-03-28 07:32:11 [auto1.de] INFO: Saving data for JG32595: {'auction_closing_time': 1774714724.0, 'created_time': 1774467223.16136, 'last_price_update_time': 1774683131.77715}
2026-03-28 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG32595') HTTP/1.1" 204 0
2026-03-28 07:32:11 [auto1.de] INFO: Found listing with ID: EN74445
2026-03-28 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN74445%27 HTTP/1.1" 200 None
2026-03-28 07:32:11 [auto1.de] INFO: Scrape type for EN74445: 0
2026-03-28 07:32:11 [auto1.de] INFO: Found listing with ID: WK54006
2026-03-28 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK54006%27 HTTP/1.1" 200 None
2026-03-28 07:32:11 [auto1.de] INFO: Scrape type for WK54006: 2
2026-03-28 07:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45934cc1-8ebd-518e-98b5-55f5adb51e3b with identifier: WK54006
2026-03-28 07:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45934cc1-8ebd-518e-98b5-55f5adb51e3b with scrape type 2
2026-03-28 07:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45934cc1-8ebd-518e-98b5-55f5adb51e3b with scrape type 2
2026-03-28 07:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45934cc1-8ebd-518e-98b5-55f5adb51e3b, identifier: WK54006
2026-03-28 07:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45934cc1-8ebd-518e-98b5-55f5adb51e3b with identifier: WK54006
2026-03-28 07:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45934cc1-8ebd-518e-98b5-55f5adb51e3b with identifier: WK54006
2026-03-28 07:32:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45934cc1-8ebd-518e-98b5-55f5adb51e3b with identifier: WK54006 to the API
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:47:07Z',
'fuel_type': 'petrol',
'id': '45934cc1-8ebd-518e-98b5-55f5adb51e3b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK54006',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 70328,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-23',
'seller_name': None,
'title': 'Opel Astra 1.4 SIDI Turbo Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2017}
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK54006%27 HTTP/1.1" 200 None
2026-03-28 07:32:12 [auto1.de] INFO: Saving data for WK54006: {'auction_closing_time': 1774716427.0, 'created_time': 1774465960.149101, 'last_price_update_time': 1774683132.221047}
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK54006') HTTP/1.1" 204 0
2026-03-28 07:32:12 [auto1.de] INFO: Found listing with ID: KE52706
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE52706%27 HTTP/1.1" 200 None
2026-03-28 07:32:12 [auto1.de] INFO: Scrape type for KE52706: 0
2026-03-28 07:32:12 [auto1.de] INFO: Found listing with ID: LZ37842
2026-03-28 07:32:12 [auto1.de] INFO: Found listing with ID: EV72489
2026-03-28 07:32:12 [auto1.de] INFO: Found listing with ID: VG17915
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG17915%27 HTTP/1.1" 200 None
2026-03-28 07:32:12 [auto1.de] INFO: Scrape type for VG17915: 0
2026-03-28 07:32:12 [auto1.de] INFO: Found listing with ID: TD10276
2026-03-28 07:32:12 [auto1.de] INFO: Found listing with ID: EG12940
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG12940%27 HTTP/1.1" 200 None
2026-03-28 07:32:12 [auto1.de] INFO: Scrape type for EG12940: 0
2026-03-28 07:32:12 [auto1.de] INFO: Found listing with ID: CW13893
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW13893%27 HTTP/1.1" 200 None
2026-03-28 07:32:12 [auto1.de] INFO: Scrape type for CW13893: 0
2026-03-28 07:32:12 [auto1.de] INFO: Found listing with ID: TZ50604
2026-03-28 07:32:12 [auto1.de] INFO: Found listing with ID: TS98691
2026-03-28 07:32:12 [auto1.de] INFO: Found listing with ID: LB13606
2026-03-28 07:32:12 [auto1.de] INFO: Found listing with ID: AT93996
2026-03-28 07:32:12 [auto1.de] INFO: Found listing with ID: TX27115
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX27115%27 HTTP/1.1" 200 None
2026-03-28 07:32:12 [auto1.de] INFO: Scrape type for TX27115: 0
2026-03-28 07:32:12 [auto1.de] INFO: Found listing with ID: PT15230
2026-03-28 07:32:12 [auto1.de] INFO: Found listing with ID: WX48966
2026-03-28 07:32:12 [auto1.de] INFO: Found listing with ID: XW48128
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW48128%27 HTTP/1.1" 200 None
2026-03-28 07:32:12 [auto1.de] INFO: Scrape type for XW48128: 0
2026-03-28 07:32:12 [auto1.de] INFO: Found listing with ID: SF00681
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF00681%27 HTTP/1.1" 200 None
2026-03-28 07:32:12 [auto1.de] INFO: Scrape type for SF00681: 0
2026-03-28 07:32:12 [auto1.de] INFO: Found listing with ID: UT79910
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT79910%27 HTTP/1.1" 200 None
2026-03-28 07:32:12 [auto1.de] INFO: Scrape type for UT79910: 0
2026-03-28 07:32:12 [auto1.de] INFO: Found listing with ID: VY57936
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY57936%27 HTTP/1.1" 200 None
2026-03-28 07:32:12 [auto1.de] INFO: Scrape type for VY57936: 0
2026-03-28 07:32:12 [auto1.de] INFO: Found listing with ID: PD39203
2026-03-28 07:32:12 [auto1.de] INFO: Found listing with ID: DG23161
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG23161%27 HTTP/1.1" 200 None
2026-03-28 07:32:12 [auto1.de] INFO: Scrape type for DG23161: 0
2026-03-28 07:32:12 [auto1.de] INFO: Found listing with ID: ES39418
2026-03-28 07:32:12 [auto1.de] INFO: Found listing with ID: AN31553
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN31553%27 HTTP/1.1" 200 None
2026-03-28 07:32:12 [auto1.de] INFO: Scrape type for AN31553: 2
2026-03-28 07:32:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0475520e-9a36-5ded-bc20-9a72e257f213 with identifier: AN31553
2026-03-28 07:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0475520e-9a36-5ded-bc20-9a72e257f213 with scrape type 2
2026-03-28 07:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0475520e-9a36-5ded-bc20-9a72e257f213 with scrape type 2
2026-03-28 07:32:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0475520e-9a36-5ded-bc20-9a72e257f213, identifier: AN31553
2026-03-28 07:32:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0475520e-9a36-5ded-bc20-9a72e257f213 with identifier: AN31553
2026-03-28 07:32:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0475520e-9a36-5ded-bc20-9a72e257f213 with identifier: AN31553
2026-03-28 07:32:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0475520e-9a36-5ded-bc20-9a72e257f213 with identifier: AN31553 to the API
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:36:34Z',
'fuel_type': 'diesel',
'id': '0475520e-9a36-5ded-bc20-9a72e257f213',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN31553',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 170845,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-13',
'seller_name': None,
'title': 'Audi Q5 2.0 TDI clean diesel quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2016}
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN31553%27 HTTP/1.1" 200 None
2026-03-28 07:32:12 [auto1.de] INFO: Saving data for AN31553: {'auction_closing_time': 1774715794.0, 'created_time': 1774464400.270585, 'last_price_update_time': 1774683132.912685}
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN31553') HTTP/1.1" 204 0
2026-03-28 07:32:13 [auto1.de] INFO: Found listing with ID: FC70862
2026-03-28 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC70862%27 HTTP/1.1" 200 None
2026-03-28 07:32:13 [auto1.de] INFO: Scrape type for FC70862: 0
2026-03-28 07:32:13 [auto1.de] INFO: Found listing with ID: WL01890
2026-03-28 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL01890%27 HTTP/1.1" 200 None
2026-03-28 07:32:13 [auto1.de] INFO: Scrape type for WL01890: 0
2026-03-28 07:32:13 [auto1.de] INFO: Found listing with ID: AG44550
2026-03-28 07:32:13 [auto1.de] INFO: Found listing with ID: PA05830
2026-03-28 07:32:13 [auto1.de] INFO: Found listing with ID: UH79601
2026-03-28 07:32:13 [auto1.de] INFO: Found listing with ID: KY88001
2026-03-28 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY88001%27 HTTP/1.1" 200 None
2026-03-28 07:32:13 [auto1.de] INFO: Scrape type for KY88001: 2
2026-03-28 07:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18d0a870-a505-5e0c-8e89-db1aa8ebcd14 with identifier: KY88001
2026-03-28 07:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18d0a870-a505-5e0c-8e89-db1aa8ebcd14 with scrape type 2
2026-03-28 07:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18d0a870-a505-5e0c-8e89-db1aa8ebcd14 with scrape type 2
2026-03-28 07:32:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18d0a870-a505-5e0c-8e89-db1aa8ebcd14, identifier: KY88001
2026-03-28 07:32:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18d0a870-a505-5e0c-8e89-db1aa8ebcd14 with identifier: KY88001
2026-03-28 07:32:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18d0a870-a505-5e0c-8e89-db1aa8ebcd14 with identifier: KY88001
2026-03-28 07:32:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18d0a870-a505-5e0c-8e89-db1aa8ebcd14 with identifier: KY88001 to the API
2026-03-28 07:32:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:15:41Z',
'fuel_type': 'diesel',
'id': '18d0a870-a505-5e0c-8e89-db1aa8ebcd14',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY88001',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 114289,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-24',
'seller_name': None,
'title': 'Audi A5 Sportback 2.0 TDI ultra',
'transmission': 'automatic',
'trim': 'ultra',
'year': 2018}
2026-03-28 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY88001%27 HTTP/1.1" 200 None
2026-03-28 07:32:13 [auto1.de] INFO: Saving data for KY88001: {'auction_closing_time': 1774714541.0, 'created_time': 1774467174.625026, 'last_price_update_time': 1774683133.487217}
2026-03-28 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY88001') HTTP/1.1" 204 0
2026-03-28 07:32:13 [auto1.de] INFO: Found listing with ID: GB19657
2026-03-28 07:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:32:14 [auto1.de] INFO: Channel: 24h | Page: 21 | totalHits: 9249 | hits on page: 40
2026-03-28 07:32:14 [auto1.de] INFO: Found listing with ID: LH02136
2026-03-28 07:32:14 [auto1.de] INFO: Found listing with ID: HZ20287
2026-03-28 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ20287%27 HTTP/1.1" 200 None
2026-03-28 07:32:14 [auto1.de] INFO: Scrape type for HZ20287: 0
2026-03-28 07:32:14 [auto1.de] INFO: Found listing with ID: RH59786
2026-03-28 07:32:14 [auto1.de] INFO: Found listing with ID: LD15809
2026-03-28 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD15809%27 HTTP/1.1" 200 None
2026-03-28 07:32:14 [auto1.de] INFO: Scrape type for LD15809: 0
2026-03-28 07:32:14 [auto1.de] INFO: Found listing with ID: BU66338
2026-03-28 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU66338%27 HTTP/1.1" 200 None
2026-03-28 07:32:14 [auto1.de] INFO: Scrape type for BU66338: 0
2026-03-28 07:32:14 [auto1.de] INFO: Found listing with ID: YK08772
2026-03-28 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK08772%27 HTTP/1.1" 200 None
2026-03-28 07:32:14 [auto1.de] INFO: Scrape type for YK08772: 2
2026-03-28 07:32:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 625bb8fd-02fd-572d-aac3-fe1a37a05878 with identifier: YK08772
2026-03-28 07:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 625bb8fd-02fd-572d-aac3-fe1a37a05878 with scrape type 2
2026-03-28 07:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 625bb8fd-02fd-572d-aac3-fe1a37a05878 with scrape type 2
2026-03-28 07:32:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 625bb8fd-02fd-572d-aac3-fe1a37a05878, identifier: YK08772
2026-03-28 07:32:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 625bb8fd-02fd-572d-aac3-fe1a37a05878 with identifier: YK08772
2026-03-28 07:32:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 625bb8fd-02fd-572d-aac3-fe1a37a05878 with identifier: YK08772
2026-03-28 07:32:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 625bb8fd-02fd-572d-aac3-fe1a37a05878 with identifier: YK08772 to the API
2026-03-28 07:32:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-28T16:13:12Z',
'fuel_type': 'petrol',
'id': '625bb8fd-02fd-572d-aac3-fe1a37a05878',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK08772',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 124848,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-03',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 BlueEfficiency Urban',
'transmission': 'automatic',
'trim': 'BlueEfficiency Urban',
'year': 2014}
2026-03-28 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK08772%27 HTTP/1.1" 200 None
2026-03-28 07:32:14 [auto1.de] INFO: Saving data for YK08772: {'auction_closing_time': 1774714392.0, 'created_time': 1774467994.631981, 'last_price_update_time': 1774683134.844592}
2026-03-28 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YK08772') HTTP/1.1" 204 0
2026-03-28 07:32:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:32:14 [auto1.de] INFO: Found listing with ID: YV33202
2026-03-28 07:32:14 [auto1.de] INFO: Found listing with ID: PK18306
2026-03-28 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK18306%27 HTTP/1.1" 200 None
2026-03-28 07:32:14 [auto1.de] INFO: Scrape type for PK18306: 0
2026-03-28 07:32:14 [auto1.de] INFO: Found listing with ID: PY30467
2026-03-28 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY30467%27 HTTP/1.1" 200 None
2026-03-28 07:32:14 [auto1.de] INFO: Scrape type for PY30467: 2
2026-03-28 07:32:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5477278-a1a3-5978-a3f4-706a0499605a with identifier: PY30467
2026-03-28 07:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5477278-a1a3-5978-a3f4-706a0499605a with scrape type 2
2026-03-28 07:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5477278-a1a3-5978-a3f4-706a0499605a with scrape type 2
2026-03-28 07:32:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5477278-a1a3-5978-a3f4-706a0499605a, identifier: PY30467
2026-03-28 07:32:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5477278-a1a3-5978-a3f4-706a0499605a with identifier: PY30467
2026-03-28 07:32:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5477278-a1a3-5978-a3f4-706a0499605a with identifier: PY30467
2026-03-28 07:32:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5477278-a1a3-5978-a3f4-706a0499605a with identifier: PY30467 to the API
2026-03-28 07:32:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 65,
'expiration_date': '2026-03-28T16:20:49Z',
'fuel_type': 'petrol',
'id': 'b5477278-a1a3-5978-a3f4-706a0499605a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY30467',
'listing': 'auction',
'make': 'Fiat',
'model': 'Grande Punto',
'odometer': 45966,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-23',
'seller_name': None,
'title': 'Fiat Grande Punto 1.2 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2009}
2026-03-28 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY30467%27 HTTP/1.1" 200 None
2026-03-28 07:32:15 [auto1.de] INFO: Saving data for PY30467: {'auction_closing_time': 1774714849.0, 'created_time': 1774467468.453886, 'last_price_update_time': 1774683135.378424}
2026-03-28 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY30467') HTTP/1.1" 204 0
2026-03-28 07:32:15 [auto1.de] INFO: Found listing with ID: DK13262
2026-03-28 07:32:15 [auto1.de] INFO: Found listing with ID: NE62435
2026-03-28 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE62435%27 HTTP/1.1" 200 None
2026-03-28 07:32:15 [auto1.de] INFO: Scrape type for NE62435: 0
2026-03-28 07:32:15 [auto1.de] INFO: Found listing with ID: VX41895
2026-03-28 07:32:15 [auto1.de] INFO: Found listing with ID: HA16942
2026-03-28 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA16942%27 HTTP/1.1" 200 None
2026-03-28 07:32:15 [auto1.de] INFO: Scrape type for HA16942: 0
2026-03-28 07:32:15 [auto1.de] INFO: Found listing with ID: GD02743
2026-03-28 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD02743%27 HTTP/1.1" 200 None
2026-03-28 07:32:15 [auto1.de] INFO: Scrape type for GD02743: 0
2026-03-28 07:32:15 [auto1.de] INFO: Found listing with ID: LF00427
2026-03-28 07:32:15 [auto1.de] INFO: Found listing with ID: MY00361
2026-03-28 07:32:15 [auto1.de] INFO: Found listing with ID: FP43907
2026-03-28 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP43907%27 HTTP/1.1" 200 None
2026-03-28 07:32:15 [auto1.de] INFO: Scrape type for FP43907: 0
2026-03-28 07:32:15 [auto1.de] INFO: Found listing with ID: MH07331
2026-03-28 07:32:15 [auto1.de] INFO: Found listing with ID: HL85444
2026-03-28 07:32:15 [auto1.de] INFO: Found listing with ID: DZ95000
2026-03-28 07:32:15 [auto1.de] INFO: Found listing with ID: JW50887
2026-03-28 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW50887%27 HTTP/1.1" 200 None
2026-03-28 07:32:15 [auto1.de] INFO: Scrape type for JW50887: 2
2026-03-28 07:32:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2adab370-e34c-5f18-a1ed-b90532f92da1 with identifier: JW50887
2026-03-28 07:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2adab370-e34c-5f18-a1ed-b90532f92da1 with scrape type 2
2026-03-28 07:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2adab370-e34c-5f18-a1ed-b90532f92da1 with scrape type 2
2026-03-28 07:32:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2adab370-e34c-5f18-a1ed-b90532f92da1, identifier: JW50887
2026-03-28 07:32:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2adab370-e34c-5f18-a1ed-b90532f92da1 with identifier: JW50887
2026-03-28 07:32:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:32:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-28 07:32:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:32:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2adab370-e34c-5f18-a1ed-b90532f92da1 with identifier: JW50887
2026-03-28 07:32:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2adab370-e34c-5f18-a1ed-b90532f92da1 with identifier: JW50887 to the API
2026-03-28 07:32:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:15:36Z',
'fuel_type': 'gas',
'id': '2adab370-e34c-5f18-a1ed-b90532f92da1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW50887',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 65516,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-18',
'seller_name': None,
'title': 'Dacia Duster 1.6 SCe Benzin / LPG Prestige',
'transmission': 'manual',
'trim': 'Prestige',
'year': 2019}
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW50887%27 HTTP/1.1" 200 None
2026-03-28 07:32:16 [auto1.de] INFO: Saving data for JW50887: {'auction_closing_time': 1774714536.0, 'created_time': 1774503038.473275, 'last_price_update_time': 1774683136.016096}
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JW50887') HTTP/1.1" 204 0
2026-03-28 07:32:16 [auto1.de] INFO: Found listing with ID: NV12597
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV12597%27 HTTP/1.1" 200 None
2026-03-28 07:32:16 [auto1.de] INFO: Scrape type for NV12597: 2
2026-03-28 07:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cece19a1-c8ab-5702-8c80-241ab2d323ec with identifier: NV12597
2026-03-28 07:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cece19a1-c8ab-5702-8c80-241ab2d323ec with scrape type 2
2026-03-28 07:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cece19a1-c8ab-5702-8c80-241ab2d323ec with scrape type 2
2026-03-28 07:32:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cece19a1-c8ab-5702-8c80-241ab2d323ec, identifier: NV12597
2026-03-28 07:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cece19a1-c8ab-5702-8c80-241ab2d323ec with identifier: NV12597
2026-03-28 07:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cece19a1-c8ab-5702-8c80-241ab2d323ec with identifier: NV12597
2026-03-28 07:32:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cece19a1-c8ab-5702-8c80-241ab2d323ec with identifier: NV12597 to the API
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 230,
'expiration_date': '2026-03-28T16:46:10Z',
'fuel_type': 'diesel',
'id': 'cece19a1-c8ab-5702-8c80-241ab2d323ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV12597',
'listing': 'auction',
'make': 'Nissan',
'model': 'Navara Pick-up',
'odometer': 204424,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-15',
'seller_name': None,
'title': 'Nissan Navara Pick-up 3.0 V6 dCi Double Cab LE 4x4',
'transmission': 'automatic',
'trim': 'Double Cab LE 4x4',
'year': 2013}
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV12597%27 HTTP/1.1" 200 None
2026-03-28 07:32:16 [auto1.de] INFO: Saving data for NV12597: {'auction_closing_time': 1774716370.0, 'created_time': 1774467995.375003, 'last_price_update_time': 1774683136.53541}
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV12597') HTTP/1.1" 204 0
2026-03-28 07:32:16 [auto1.de] INFO: Found listing with ID: XM88485
2026-03-28 07:32:16 [auto1.de] INFO: Found listing with ID: XT03032
2026-03-28 07:32:16 [auto1.de] INFO: Found listing with ID: NG74955
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG74955%27 HTTP/1.1" 200 None
2026-03-28 07:32:16 [auto1.de] INFO: Scrape type for NG74955: 0
2026-03-28 07:32:16 [auto1.de] INFO: Found listing with ID: MW79572
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW79572%27 HTTP/1.1" 200 None
2026-03-28 07:32:16 [auto1.de] INFO: Scrape type for MW79572: 0
2026-03-28 07:32:16 [auto1.de] INFO: Found listing with ID: NE74286
2026-03-28 07:32:16 [auto1.de] INFO: Found listing with ID: VF88904
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF88904%27 HTTP/1.1" 200 None
2026-03-28 07:32:16 [auto1.de] INFO: Scrape type for VF88904: 2
2026-03-28 07:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c02b792-4a04-5e3a-b0ee-1b272ce0f1c8 with identifier: VF88904
2026-03-28 07:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c02b792-4a04-5e3a-b0ee-1b272ce0f1c8 with scrape type 2
2026-03-28 07:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c02b792-4a04-5e3a-b0ee-1b272ce0f1c8 with scrape type 2
2026-03-28 07:32:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c02b792-4a04-5e3a-b0ee-1b272ce0f1c8, identifier: VF88904
2026-03-28 07:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c02b792-4a04-5e3a-b0ee-1b272ce0f1c8 with identifier: VF88904
2026-03-28 07:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c02b792-4a04-5e3a-b0ee-1b272ce0f1c8 with identifier: VF88904
2026-03-28 07:32:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c02b792-4a04-5e3a-b0ee-1b272ce0f1c8 with identifier: VF88904 to the API
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:15:27Z',
'fuel_type': 'diesel',
'id': '0c02b792-4a04-5e3a-b0ee-1b272ce0f1c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF88904',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 154925,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-10',
'seller_name': None,
'title': 'Hyundai i30 1.6 CRDi Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2011}
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF88904%27 HTTP/1.1" 200 None
2026-03-28 07:32:16 [auto1.de] INFO: Saving data for VF88904: {'auction_closing_time': 1774714527.0, 'created_time': 1774467688.350529, 'last_price_update_time': 1774683136.966786}
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VF88904') HTTP/1.1" 204 0
2026-03-28 07:32:16 [auto1.de] INFO: Found listing with ID: WL56832
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL56832%27 HTTP/1.1" 200 None
2026-03-28 07:32:16 [auto1.de] INFO: Scrape type for WL56832: 0
2026-03-28 07:32:16 [auto1.de] INFO: Found listing with ID: GG07111
2026-03-28 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG07111%27 HTTP/1.1" 200 None
2026-03-28 07:32:17 [auto1.de] INFO: Scrape type for GG07111: 0
2026-03-28 07:32:17 [auto1.de] INFO: Found listing with ID: XB94191
2026-03-28 07:32:17 [auto1.de] INFO: Found listing with ID: FP97739
2026-03-28 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP97739%27 HTTP/1.1" 200 None
2026-03-28 07:32:17 [auto1.de] INFO: Scrape type for FP97739: 0
2026-03-28 07:32:17 [auto1.de] INFO: Found listing with ID: KY82766
2026-03-28 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY82766%27 HTTP/1.1" 200 None
2026-03-28 07:32:17 [auto1.de] INFO: Scrape type for KY82766: 2
2026-03-28 07:32:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdfd80da-bf5f-596d-9118-3519a7b83532 with identifier: KY82766
2026-03-28 07:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdfd80da-bf5f-596d-9118-3519a7b83532 with scrape type 2
2026-03-28 07:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdfd80da-bf5f-596d-9118-3519a7b83532 with scrape type 2
2026-03-28 07:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdfd80da-bf5f-596d-9118-3519a7b83532, identifier: KY82766
2026-03-28 07:32:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdfd80da-bf5f-596d-9118-3519a7b83532 with identifier: KY82766
2026-03-28 07:32:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdfd80da-bf5f-596d-9118-3519a7b83532 with identifier: KY82766
2026-03-28 07:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdfd80da-bf5f-596d-9118-3519a7b83532 with identifier: KY82766 to the API
2026-03-28 07:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:27:22Z',
'fuel_type': 'diesel',
'id': 'bdfd80da-bf5f-596d-9118-3519a7b83532',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY82766',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 199664,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-17',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Match BlueMotion',
'transmission': 'manual',
'trim': 'Match BlueMotion',
'year': 2012}
2026-03-28 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY82766%27 HTTP/1.1" 200 None
2026-03-28 07:32:17 [auto1.de] INFO: Saving data for KY82766: {'auction_closing_time': 1774715242.0, 'created_time': 1773859728.689428, 'last_price_update_time': 1774683137.431697}
2026-03-28 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY82766') HTTP/1.1" 204 0
2026-03-28 07:32:17 [auto1.de] INFO: Found listing with ID: EP96455
2026-03-28 07:32:17 [auto1.de] INFO: Found listing with ID: CW57830
2026-03-28 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW57830%27 HTTP/1.1" 200 None
2026-03-28 07:32:17 [auto1.de] INFO: Scrape type for CW57830: 0
2026-03-28 07:32:17 [auto1.de] INFO: Found listing with ID: TP36932
2026-03-28 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP36932%27 HTTP/1.1" 200 None
2026-03-28 07:32:17 [auto1.de] INFO: Scrape type for TP36932: 2
2026-03-28 07:32:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4c4e902-2275-50c6-ac03-3482b46b9285 with identifier: TP36932
2026-03-28 07:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4c4e902-2275-50c6-ac03-3482b46b9285 with scrape type 2
2026-03-28 07:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4c4e902-2275-50c6-ac03-3482b46b9285 with scrape type 2
2026-03-28 07:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4c4e902-2275-50c6-ac03-3482b46b9285, identifier: TP36932
2026-03-28 07:32:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4c4e902-2275-50c6-ac03-3482b46b9285 with identifier: TP36932
2026-03-28 07:32:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4c4e902-2275-50c6-ac03-3482b46b9285 with identifier: TP36932
2026-03-28 07:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4c4e902-2275-50c6-ac03-3482b46b9285 with identifier: TP36932 to the API
2026-03-28 07:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 210,
'expiration_date': '2026-03-28T16:37:32Z',
'fuel_type': 'petrol',
'id': 'c4c4e902-2275-50c6-ac03-3482b46b9285',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP36932',
'listing': 'auction',
'make': 'Opel',
'model': 'Signum',
'odometer': 98100,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-04-29',
'seller_name': None,
'title': 'Opel Signum 3.2 V6 Cosmo',
'transmission': 'manual',
'trim': 'Cosmo',
'year': 2004}
2026-03-28 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP36932%27 HTTP/1.1" 200 None
2026-03-28 07:32:17 [auto1.de] INFO: Saving data for TP36932: {'auction_closing_time': 1774715852.0, 'created_time': 1774468029.704481, 'last_price_update_time': 1774683137.966884}
2026-03-28 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP36932') HTTP/1.1" 204 0
2026-03-28 07:32:17 [auto1.de] INFO: Found listing with ID: HK49782
2026-03-28 07:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK49782%27 HTTP/1.1" 200 None
2026-03-28 07:32:18 [auto1.de] INFO: Scrape type for HK49782: 0
2026-03-28 07:32:18 [auto1.de] INFO: Found listing with ID: SS86318
2026-03-28 07:32:18 [auto1.de] INFO: Found listing with ID: TC07570
2026-03-28 07:32:18 [auto1.de] INFO: Found listing with ID: XT11627
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT11627%27 HTTP/1.1" 200 None
2026-03-28 07:32:18 [auto1.de] INFO: Scrape type for XT11627: 0
2026-03-28 07:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:32:18 [auto1.de] INFO: Channel: 24h | Page: 22 | totalHits: 9249 | hits on page: 40
2026-03-28 07:32:18 [auto1.de] INFO: Found listing with ID: CZ05672
2026-03-28 07:32:18 [auto1.de] INFO: Found listing with ID: AT18561
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT18561%27 HTTP/1.1" 200 None
2026-03-28 07:32:18 [auto1.de] INFO: Scrape type for AT18561: 0
2026-03-28 07:32:18 [auto1.de] INFO: Found listing with ID: ZY97327
2026-03-28 07:32:18 [auto1.de] INFO: Found listing with ID: ES68106
2026-03-28 07:32:18 [auto1.de] INFO: Found listing with ID: PV88809
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV88809%27 HTTP/1.1" 200 None
2026-03-28 07:32:18 [auto1.de] INFO: Scrape type for PV88809: 0
2026-03-28 07:32:18 [auto1.de] INFO: Found listing with ID: TV33488
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV33488%27 HTTP/1.1" 200 None
2026-03-28 07:32:18 [auto1.de] INFO: Scrape type for TV33488: 0
2026-03-28 07:32:18 [auto1.de] INFO: Found listing with ID: GP39031
2026-03-28 07:32:18 [auto1.de] INFO: Found listing with ID: WA19353
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA19353%27 HTTP/1.1" 200 None
2026-03-28 07:32:18 [auto1.de] INFO: Scrape type for WA19353: 0
2026-03-28 07:32:18 [auto1.de] INFO: Found listing with ID: ZM28041
2026-03-28 07:32:18 [auto1.de] INFO: Found listing with ID: TJ20795
2026-03-28 07:32:18 [auto1.de] INFO: Found listing with ID: WZ91552
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ91552%27 HTTP/1.1" 200 None
2026-03-28 07:32:18 [auto1.de] INFO: Scrape type for WZ91552: 2
2026-03-28 07:32:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23967aee-8c8c-5214-b8cf-150c9c4b90a1 with identifier: WZ91552
2026-03-28 07:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23967aee-8c8c-5214-b8cf-150c9c4b90a1 with scrape type 2
2026-03-28 07:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23967aee-8c8c-5214-b8cf-150c9c4b90a1 with scrape type 2
2026-03-28 07:32:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23967aee-8c8c-5214-b8cf-150c9c4b90a1, identifier: WZ91552
2026-03-28 07:32:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23967aee-8c8c-5214-b8cf-150c9c4b90a1 with identifier: WZ91552
2026-03-28 07:32:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23967aee-8c8c-5214-b8cf-150c9c4b90a1 with identifier: WZ91552
2026-03-28 07:32:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23967aee-8c8c-5214-b8cf-150c9c4b90a1 with identifier: WZ91552 to the API
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:45:08Z',
'fuel_type': 'petrol',
'id': '23967aee-8c8c-5214-b8cf-150c9c4b90a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ91552',
'listing': 'auction',
'make': 'Ford',
'model': 'EcoSport',
'odometer': 61661,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-22',
'seller_name': None,
'title': 'Ford EcoSport 1.0 EcoBoost ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2018}
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ91552%27 HTTP/1.1" 200 None
2026-03-28 07:32:18 [auto1.de] INFO: Saving data for WZ91552: {'auction_closing_time': 1774716308.0, 'created_time': 1774468122.565323, 'last_price_update_time': 1774683138.64151}
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ91552') HTTP/1.1" 204 0
2026-03-28 07:32:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:32:18 [auto1.de] INFO: Found listing with ID: TA55344
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA55344%27 HTTP/1.1" 200 None
2026-03-28 07:32:18 [auto1.de] INFO: Scrape type for TA55344: 0
2026-03-28 07:32:18 [auto1.de] INFO: Found listing with ID: MF63690
2026-03-28 07:32:18 [auto1.de] INFO: Found listing with ID: VH13590
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH13590%27 HTTP/1.1" 200 None
2026-03-28 07:32:18 [auto1.de] INFO: Scrape type for VH13590: 0
2026-03-28 07:32:18 [auto1.de] INFO: Found listing with ID: TU13960
2026-03-28 07:32:18 [auto1.de] INFO: Found listing with ID: LA33826
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA33826%27 HTTP/1.1" 200 None
2026-03-28 07:32:18 [auto1.de] INFO: Scrape type for LA33826: 2
2026-03-28 07:32:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d687415a-bbdf-5e3b-8e67-3bf0e845d9e0 with identifier: LA33826
2026-03-28 07:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d687415a-bbdf-5e3b-8e67-3bf0e845d9e0 with scrape type 2
2026-03-28 07:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d687415a-bbdf-5e3b-8e67-3bf0e845d9e0 with scrape type 2
2026-03-28 07:32:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d687415a-bbdf-5e3b-8e67-3bf0e845d9e0, identifier: LA33826
2026-03-28 07:32:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d687415a-bbdf-5e3b-8e67-3bf0e845d9e0 with identifier: LA33826
2026-03-28 07:32:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d687415a-bbdf-5e3b-8e67-3bf0e845d9e0 with identifier: LA33826
2026-03-28 07:32:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d687415a-bbdf-5e3b-8e67-3bf0e845d9e0 with identifier: LA33826 to the API
2026-03-28 07:32:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:56:28Z',
'fuel_type': 'diesel',
'id': 'd687415a-bbdf-5e3b-8e67-3bf0e845d9e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA33826',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 57971,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-07',
'seller_name': None,
'title': 'Renault Kadjar 1.5 dCi Energy Business Edition',
'transmission': 'automatic',
'trim': 'Business Edition',
'year': 2018}
2026-03-28 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA33826%27 HTTP/1.1" 200 None
2026-03-28 07:32:19 [auto1.de] INFO: Saving data for LA33826: {'auction_closing_time': 1774716988.0, 'created_time': 1774467453.717063, 'last_price_update_time': 1774683139.213616}
2026-03-28 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA33826') HTTP/1.1" 204 0
2026-03-28 07:32:19 [auto1.de] INFO: Found listing with ID: KA93370
2026-03-28 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA93370%27 HTTP/1.1" 200 None
2026-03-28 07:32:19 [auto1.de] INFO: Scrape type for KA93370: 2
2026-03-28 07:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd4bbd49-b47e-5ad6-b733-e2e1656f1ea8 with identifier: KA93370
2026-03-28 07:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd4bbd49-b47e-5ad6-b733-e2e1656f1ea8 with scrape type 2
2026-03-28 07:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd4bbd49-b47e-5ad6-b733-e2e1656f1ea8 with scrape type 2
2026-03-28 07:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd4bbd49-b47e-5ad6-b733-e2e1656f1ea8, identifier: KA93370
2026-03-28 07:32:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd4bbd49-b47e-5ad6-b733-e2e1656f1ea8 with identifier: KA93370
2026-03-28 07:32:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd4bbd49-b47e-5ad6-b733-e2e1656f1ea8 with identifier: KA93370
2026-03-28 07:32:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd4bbd49-b47e-5ad6-b733-e2e1656f1ea8 with identifier: KA93370 to the API
2026-03-28 07:32:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:25:37Z',
'fuel_type': 'petrol',
'id': 'cd4bbd49-b47e-5ad6-b733-e2e1656f1ea8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA93370',
'listing': 'auction',
'make': 'Fiat',
'model': 'Tipo',
'odometer': 143054,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-27',
'seller_name': None,
'title': 'Fiat Tipo 1.4 Pop',
'transmission': 'manual',
'trim': 'Pop',
'year': 2017}
2026-03-28 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA93370%27 HTTP/1.1" 200 None
2026-03-28 07:32:19 [auto1.de] INFO: Saving data for KA93370: {'auction_closing_time': 1774715137.0, 'created_time': 1774466903.302118, 'last_price_update_time': 1774683139.668085}
2026-03-28 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA93370') HTTP/1.1" 204 0
2026-03-28 07:32:19 [auto1.de] INFO: Found listing with ID: CP06642
2026-03-28 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP06642%27 HTTP/1.1" 200 None
2026-03-28 07:32:19 [auto1.de] INFO: Scrape type for CP06642: 0
2026-03-28 07:32:19 [auto1.de] INFO: Found listing with ID: SY11471
2026-03-28 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY11471%27 HTTP/1.1" 200 None
2026-03-28 07:32:19 [auto1.de] INFO: Scrape type for SY11471: 0
2026-03-28 07:32:19 [auto1.de] INFO: Found listing with ID: DR68264
2026-03-28 07:32:19 [auto1.de] INFO: Found listing with ID: YU32339
2026-03-28 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU32339%27 HTTP/1.1" 200 None
2026-03-28 07:32:19 [auto1.de] INFO: Scrape type for YU32339: 2
2026-03-28 07:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fe84ad1-f3db-5142-8925-2413dfde386c with identifier: YU32339
2026-03-28 07:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fe84ad1-f3db-5142-8925-2413dfde386c with scrape type 2
2026-03-28 07:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fe84ad1-f3db-5142-8925-2413dfde386c with scrape type 2
2026-03-28 07:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2fe84ad1-f3db-5142-8925-2413dfde386c, identifier: YU32339
2026-03-28 07:32:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2fe84ad1-f3db-5142-8925-2413dfde386c with identifier: YU32339
2026-03-28 07:32:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2fe84ad1-f3db-5142-8925-2413dfde386c with identifier: YU32339
2026-03-28 07:32:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2fe84ad1-f3db-5142-8925-2413dfde386c with identifier: YU32339 to the API
2026-03-28 07:32:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:15:23Z',
'fuel_type': 'diesel',
'id': '2fe84ad1-f3db-5142-8925-2413dfde386c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU32339',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 152223,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-12',
'seller_name': None,
'title': 'Nissan Qashqai 1.6 dCi N-Connecta 4x4',
'transmission': 'manual',
'trim': 'N-Connecta 4x4',
'year': 2017}
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU32339%27 HTTP/1.1" 200 None
2026-03-28 07:32:20 [auto1.de] INFO: Saving data for YU32339: {'auction_closing_time': 1774714523.0, 'created_time': 1774466439.118581, 'last_price_update_time': 1774683140.161656}
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU32339') HTTP/1.1" 204 0
2026-03-28 07:32:20 [auto1.de] INFO: Found listing with ID: GL86487
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL86487%27 HTTP/1.1" 200 None
2026-03-28 07:32:20 [auto1.de] INFO: Scrape type for GL86487: 0
2026-03-28 07:32:20 [auto1.de] INFO: Found listing with ID: SY69766
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY69766%27 HTTP/1.1" 200 None
2026-03-28 07:32:20 [auto1.de] INFO: Scrape type for SY69766: 0
2026-03-28 07:32:20 [auto1.de] INFO: Found listing with ID: TN44984
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN44984%27 HTTP/1.1" 200 None
2026-03-28 07:32:20 [auto1.de] INFO: Scrape type for TN44984: 0
2026-03-28 07:32:20 [auto1.de] INFO: Found listing with ID: MX47183
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX47183%27 HTTP/1.1" 200 None
2026-03-28 07:32:20 [auto1.de] INFO: Scrape type for MX47183: 0
2026-03-28 07:32:20 [auto1.de] INFO: Found listing with ID: LB62140
2026-03-28 07:32:20 [auto1.de] INFO: Found listing with ID: WT89497
2026-03-28 07:32:20 [auto1.de] INFO: Found listing with ID: VC12091
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC12091%27 HTTP/1.1" 200 None
2026-03-28 07:32:20 [auto1.de] INFO: Scrape type for VC12091: 0
2026-03-28 07:32:20 [auto1.de] INFO: Found listing with ID: HN27316
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN27316%27 HTTP/1.1" 200 None
2026-03-28 07:32:20 [auto1.de] INFO: Scrape type for HN27316: 0
2026-03-28 07:32:20 [auto1.de] INFO: Found listing with ID: LW48006
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW48006%27 HTTP/1.1" 200 None
2026-03-28 07:32:20 [auto1.de] INFO: Scrape type for LW48006: 0
2026-03-28 07:32:20 [auto1.de] INFO: Found listing with ID: MH82914
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH82914%27 HTTP/1.1" 200 None
2026-03-28 07:32:20 [auto1.de] INFO: Scrape type for MH82914: 0
2026-03-28 07:32:20 [auto1.de] INFO: Found listing with ID: SY19126
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY19126%27 HTTP/1.1" 200 None
2026-03-28 07:32:20 [auto1.de] INFO: Scrape type for SY19126: 0
2026-03-28 07:32:20 [auto1.de] INFO: Found listing with ID: HH63715
2026-03-28 07:32:20 [auto1.de] INFO: Found listing with ID: HP91668
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP91668%27 HTTP/1.1" 200 None
2026-03-28 07:32:20 [auto1.de] INFO: Scrape type for HP91668: 0
2026-03-28 07:32:20 [auto1.de] INFO: Found listing with ID: AG68218
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68218%27 HTTP/1.1" 200 None
2026-03-28 07:32:20 [auto1.de] INFO: Scrape type for AG68218: 0
2026-03-28 07:32:20 [auto1.de] INFO: Found listing with ID: RG80046
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG80046%27 HTTP/1.1" 200 None
2026-03-28 07:32:20 [auto1.de] INFO: Scrape type for RG80046: 0
2026-03-28 07:32:20 [auto1.de] INFO: Found listing with ID: HE16433
2026-03-28 07:32:20 [auto1.de] INFO: Found listing with ID: GD20981
2026-03-28 07:32:20 [auto1.de] INFO: Found listing with ID: WP39257
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP39257%27 HTTP/1.1" 200 None
2026-03-28 07:32:20 [auto1.de] INFO: Scrape type for WP39257: 2
2026-03-28 07:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16edc4d2-4321-5e5b-81d1-c17c9a2c8fac with identifier: WP39257
2026-03-28 07:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16edc4d2-4321-5e5b-81d1-c17c9a2c8fac with scrape type 2
2026-03-28 07:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16edc4d2-4321-5e5b-81d1-c17c9a2c8fac with scrape type 2
2026-03-28 07:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 16edc4d2-4321-5e5b-81d1-c17c9a2c8fac, identifier: WP39257
2026-03-28 07:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 16edc4d2-4321-5e5b-81d1-c17c9a2c8fac with identifier: WP39257
2026-03-28 07:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 16edc4d2-4321-5e5b-81d1-c17c9a2c8fac with identifier: WP39257
2026-03-28 07:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 16edc4d2-4321-5e5b-81d1-c17c9a2c8fac with identifier: WP39257 to the API
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:55:16Z',
'fuel_type': 'diesel',
'id': '16edc4d2-4321-5e5b-81d1-c17c9a2c8fac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP39257',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 92572,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-26',
'seller_name': None,
'title': 'Audi Q5 40 TDI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2018}
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP39257%27 HTTP/1.1" 200 None
2026-03-28 07:32:20 [auto1.de] INFO: Saving data for WP39257: {'auction_closing_time': 1774716916.0, 'created_time': 1774467875.650148, 'last_price_update_time': 1774683140.821724}
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP39257') HTTP/1.1" 204 0
2026-03-28 07:32:20 [auto1.de] INFO: Found listing with ID: SY31818
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY31818%27 HTTP/1.1" 200 None
2026-03-28 07:32:20 [auto1.de] INFO: Scrape type for SY31818: 0
2026-03-28 07:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:32:22 [auto1.de] INFO: Channel: 24h | Page: 23 | totalHits: 9250 | hits on page: 40
2026-03-28 07:32:22 [auto1.de] INFO: Found listing with ID: SY31818
2026-03-28 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY31818%27 HTTP/1.1" 200 None
2026-03-28 07:32:22 [auto1.de] INFO: Scrape type for SY31818: 0
2026-03-28 07:32:22 [auto1.de] INFO: Found listing with ID: AU38078
2026-03-28 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU38078%27 HTTP/1.1" 200 None
2026-03-28 07:32:22 [auto1.de] INFO: Scrape type for AU38078: 0
2026-03-28 07:32:22 [auto1.de] INFO: Found listing with ID: LF70646
2026-03-28 07:32:22 [auto1.de] INFO: Found listing with ID: WP28886
2026-03-28 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP28886%27 HTTP/1.1" 200 None
2026-03-28 07:32:22 [auto1.de] INFO: Scrape type for WP28886: 0
2026-03-28 07:32:22 [auto1.de] INFO: Found listing with ID: ZZ21826
2026-03-28 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ21826%27 HTTP/1.1" 200 None
2026-03-28 07:32:22 [auto1.de] INFO: Scrape type for ZZ21826: 2
2026-03-28 07:32:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24988fcd-7d66-58e7-bd10-da2b0099b329 with identifier: ZZ21826
2026-03-28 07:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24988fcd-7d66-58e7-bd10-da2b0099b329 with scrape type 2
2026-03-28 07:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24988fcd-7d66-58e7-bd10-da2b0099b329 with scrape type 2
2026-03-28 07:32:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24988fcd-7d66-58e7-bd10-da2b0099b329, identifier: ZZ21826
2026-03-28 07:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24988fcd-7d66-58e7-bd10-da2b0099b329 with identifier: ZZ21826
2026-03-28 07:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24988fcd-7d66-58e7-bd10-da2b0099b329 with identifier: ZZ21826
2026-03-28 07:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24988fcd-7d66-58e7-bd10-da2b0099b329 with identifier: ZZ21826 to the API
2026-03-28 07:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:31:13Z',
'fuel_type': 'diesel',
'id': '24988fcd-7d66-58e7-bd10-da2b0099b329',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ21826',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 162182,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-06-01',
'seller_name': None,
'title': 'Mercedes-Benz Vito 111 CDI Lang',
'transmission': 'manual',
'trim': 'Lang',
'year': 2006}
2026-03-28 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ21826%27 HTTP/1.1" 200 None
2026-03-28 07:32:22 [auto1.de] INFO: Saving data for ZZ21826: {'auction_closing_time': 1774715473.0, 'created_time': 1774465269.713339, 'last_price_update_time': 1774683142.985362}
2026-03-28 07:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ21826') HTTP/1.1" 204 0
2026-03-28 07:32:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:32:23 [auto1.de] INFO: Found listing with ID: GE17394
2026-03-28 07:32:23 [auto1.de] INFO: Found listing with ID: LA48706
2026-03-28 07:32:23 [auto1.de] INFO: Found listing with ID: MR72377
2026-03-28 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR72377%27 HTTP/1.1" 200 None
2026-03-28 07:32:23 [auto1.de] INFO: Scrape type for MR72377: 0
2026-03-28 07:32:23 [auto1.de] INFO: Found listing with ID: YE65319
2026-03-28 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE65319%27 HTTP/1.1" 200 None
2026-03-28 07:32:23 [auto1.de] INFO: Scrape type for YE65319: 2
2026-03-28 07:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dadd15c3-ac1f-5cf1-8f39-bf98d7024e09 with identifier: YE65319
2026-03-28 07:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dadd15c3-ac1f-5cf1-8f39-bf98d7024e09 with scrape type 2
2026-03-28 07:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dadd15c3-ac1f-5cf1-8f39-bf98d7024e09 with scrape type 2
2026-03-28 07:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dadd15c3-ac1f-5cf1-8f39-bf98d7024e09, identifier: YE65319
2026-03-28 07:32:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dadd15c3-ac1f-5cf1-8f39-bf98d7024e09 with identifier: YE65319
2026-03-28 07:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dadd15c3-ac1f-5cf1-8f39-bf98d7024e09 with identifier: YE65319
2026-03-28 07:32:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dadd15c3-ac1f-5cf1-8f39-bf98d7024e09 with identifier: YE65319 to the API
2026-03-28 07:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-28T16:59:37Z',
'fuel_type': 'petrol',
'id': 'dadd15c3-ac1f-5cf1-8f39-bf98d7024e09',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE65319',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 67263,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-30',
'seller_name': None,
'title': 'Ford Fiesta 1.25 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2016}
2026-03-28 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE65319%27 HTTP/1.1" 200 None
2026-03-28 07:32:23 [auto1.de] INFO: Saving data for YE65319: {'auction_closing_time': 1774717177.0, 'created_time': 1774032245.726123, 'last_price_update_time': 1774683143.454848}
2026-03-28 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE65319') HTTP/1.1" 204 0
2026-03-28 07:32:23 [auto1.de] INFO: Found listing with ID: AF76763
2026-03-28 07:32:23 [auto1.de] INFO: Found listing with ID: PC91683
2026-03-28 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC91683%27 HTTP/1.1" 200 None
2026-03-28 07:32:23 [auto1.de] INFO: Scrape type for PC91683: 0
2026-03-28 07:32:23 [auto1.de] INFO: Found listing with ID: DC40385
2026-03-28 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC40385%27 HTTP/1.1" 200 None
2026-03-28 07:32:23 [auto1.de] INFO: Scrape type for DC40385: 2
2026-03-28 07:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9f47a57-99ea-51cd-834e-d23d36b18c1b with identifier: DC40385
2026-03-28 07:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9f47a57-99ea-51cd-834e-d23d36b18c1b with scrape type 2
2026-03-28 07:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9f47a57-99ea-51cd-834e-d23d36b18c1b with scrape type 2
2026-03-28 07:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9f47a57-99ea-51cd-834e-d23d36b18c1b, identifier: DC40385
2026-03-28 07:32:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9f47a57-99ea-51cd-834e-d23d36b18c1b with identifier: DC40385
2026-03-28 07:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9f47a57-99ea-51cd-834e-d23d36b18c1b with identifier: DC40385
2026-03-28 07:32:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9f47a57-99ea-51cd-834e-d23d36b18c1b with identifier: DC40385 to the API
2026-03-28 07:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:51:19Z',
'fuel_type': 'diesel',
'id': 'c9f47a57-99ea-51cd-834e-d23d36b18c1b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC40385',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 84662,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-11',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2018}
2026-03-28 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC40385%27 HTTP/1.1" 200 None
2026-03-28 07:32:23 [auto1.de] INFO: Saving data for DC40385: {'auction_closing_time': 1774716679.0, 'created_time': 1774466981.004657, 'last_price_update_time': 1774683143.915864}
2026-03-28 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC40385') HTTP/1.1" 204 0
2026-03-28 07:32:24 [auto1.de] INFO: Found listing with ID: ZM52158
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM52158%27 HTTP/1.1" 200 None
2026-03-28 07:32:24 [auto1.de] INFO: Scrape type for ZM52158: 0
2026-03-28 07:32:24 [auto1.de] INFO: Found listing with ID: ZN33524
2026-03-28 07:32:24 [auto1.de] INFO: Found listing with ID: AT13824
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT13824%27 HTTP/1.1" 200 None
2026-03-28 07:32:24 [auto1.de] INFO: Scrape type for AT13824: 2
2026-03-28 07:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edc48375-30cb-5995-b34e-bcb3f3029de8 with identifier: AT13824
2026-03-28 07:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edc48375-30cb-5995-b34e-bcb3f3029de8 with scrape type 2
2026-03-28 07:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edc48375-30cb-5995-b34e-bcb3f3029de8 with scrape type 2
2026-03-28 07:32:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edc48375-30cb-5995-b34e-bcb3f3029de8, identifier: AT13824
2026-03-28 07:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edc48375-30cb-5995-b34e-bcb3f3029de8 with identifier: AT13824
2026-03-28 07:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edc48375-30cb-5995-b34e-bcb3f3029de8 with identifier: AT13824
2026-03-28 07:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edc48375-30cb-5995-b34e-bcb3f3029de8 with identifier: AT13824 to the API
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:33:38Z',
'fuel_type': 'petrol',
'id': 'edc48375-30cb-5995-b34e-bcb3f3029de8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT13824',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 57276,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-04',
'seller_name': None,
'title': 'Opel Corsa 1.2 Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2010}
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT13824%27 HTTP/1.1" 200 None
2026-03-28 07:32:24 [auto1.de] INFO: Saving data for AT13824: {'auction_closing_time': 1774715618.0, 'created_time': 1774466865.792694, 'last_price_update_time': 1774683144.45929}
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AT13824') HTTP/1.1" 204 0
2026-03-28 07:32:24 [auto1.de] INFO: Found listing with ID: JM14799
2026-03-28 07:32:24 [auto1.de] INFO: Found listing with ID: XR01056
2026-03-28 07:32:24 [auto1.de] INFO: Found listing with ID: BE73867
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE73867%27 HTTP/1.1" 200 None
2026-03-28 07:32:24 [auto1.de] INFO: Scrape type for BE73867: 2
2026-03-28 07:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1f9bd55-5c43-5965-b643-ddc65b816fda with identifier: BE73867
2026-03-28 07:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1f9bd55-5c43-5965-b643-ddc65b816fda with scrape type 2
2026-03-28 07:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1f9bd55-5c43-5965-b643-ddc65b816fda with scrape type 2
2026-03-28 07:32:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1f9bd55-5c43-5965-b643-ddc65b816fda, identifier: BE73867
2026-03-28 07:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1f9bd55-5c43-5965-b643-ddc65b816fda with identifier: BE73867
2026-03-28 07:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1f9bd55-5c43-5965-b643-ddc65b816fda with identifier: BE73867
2026-03-28 07:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1f9bd55-5c43-5965-b643-ddc65b816fda with identifier: BE73867 to the API
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:00:19Z',
'fuel_type': 'diesel',
'id': 'b1f9bd55-5c43-5965-b643-ddc65b816fda',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE73867',
'listing': 'auction',
'make': 'Opel',
'model': 'Antara',
'odometer': 65486,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-08',
'seller_name': None,
'title': 'Opel Antara 2.0 CDTI Cosmo 4x4',
'transmission': 'automatic',
'trim': 'Cosmo 4x4',
'year': 2009}
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE73867%27 HTTP/1.1" 200 None
2026-03-28 07:32:24 [auto1.de] INFO: Saving data for BE73867: {'auction_closing_time': 1774713619.0, 'created_time': 1774467722.392022, 'last_price_update_time': 1774683144.881134}
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE73867') HTTP/1.1" 204 0
2026-03-28 07:32:24 [auto1.de] INFO: Found listing with ID: LC46015
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC46015%27 HTTP/1.1" 200 None
2026-03-28 07:32:24 [auto1.de] INFO: Scrape type for LC46015: 0
2026-03-28 07:32:24 [auto1.de] INFO: Found listing with ID: WZ86962
2026-03-28 07:32:24 [auto1.de] INFO: Found listing with ID: RJ57220
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ57220%27 HTTP/1.1" 200 None
2026-03-28 07:32:24 [auto1.de] INFO: Scrape type for RJ57220: 0
2026-03-28 07:32:24 [auto1.de] INFO: Found listing with ID: BS30478
2026-03-28 07:32:24 [auto1.de] INFO: Found listing with ID: BD66077
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD66077%27 HTTP/1.1" 200 None
2026-03-28 07:32:24 [auto1.de] INFO: Scrape type for BD66077: 0
2026-03-28 07:32:24 [auto1.de] INFO: Found listing with ID: ZH34670
2026-03-28 07:32:24 [auto1.de] INFO: Found listing with ID: XA84499
2026-03-28 07:32:24 [auto1.de] INFO: Found listing with ID: KZ90725
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ90725%27 HTTP/1.1" 200 None
2026-03-28 07:32:24 [auto1.de] INFO: Scrape type for KZ90725: 2
2026-03-28 07:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 872082ce-46b5-579c-8216-ff01a20dae57 with identifier: KZ90725
2026-03-28 07:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 872082ce-46b5-579c-8216-ff01a20dae57 with scrape type 2
2026-03-28 07:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 872082ce-46b5-579c-8216-ff01a20dae57 with scrape type 2
2026-03-28 07:32:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 872082ce-46b5-579c-8216-ff01a20dae57, identifier: KZ90725
2026-03-28 07:32:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 872082ce-46b5-579c-8216-ff01a20dae57 with identifier: KZ90725
2026-03-28 07:32:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 872082ce-46b5-579c-8216-ff01a20dae57 with identifier: KZ90725
2026-03-28 07:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 872082ce-46b5-579c-8216-ff01a20dae57 with identifier: KZ90725 to the API
2026-03-28 07:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 145,
'expiration_date': '2026-03-28T16:54:20Z',
'fuel_type': 'petrol',
'id': '872082ce-46b5-579c-8216-ff01a20dae57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ90725',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 249269,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-09-10',
'seller_name': None,
'title': 'Ford Mondeo 2.0 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2007}
2026-03-28 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ90725%27 HTTP/1.1" 200 None
2026-03-28 07:32:25 [auto1.de] INFO: Saving data for KZ90725: {'auction_closing_time': 1774716860.0, 'created_time': 1774467718.003512, 'last_price_update_time': 1774683145.356504}
2026-03-28 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ90725') HTTP/1.1" 204 0
2026-03-28 07:32:25 [auto1.de] INFO: Found listing with ID: HD47083
2026-03-28 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD47083%27 HTTP/1.1" 200 None
2026-03-28 07:32:25 [auto1.de] INFO: Scrape type for HD47083: 0
2026-03-28 07:32:25 [auto1.de] INFO: Found listing with ID: DH93175
2026-03-28 07:32:25 [auto1.de] INFO: Found listing with ID: XF69711
2026-03-28 07:32:25 [auto1.de] INFO: Found listing with ID: LB61549
2026-03-28 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB61549%27 HTTP/1.1" 200 None
2026-03-28 07:32:25 [auto1.de] INFO: Scrape type for LB61549: 2
2026-03-28 07:32:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd549500-733e-5e6d-92df-d59b0c4f3801 with identifier: LB61549
2026-03-28 07:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd549500-733e-5e6d-92df-d59b0c4f3801 with scrape type 2
2026-03-28 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd549500-733e-5e6d-92df-d59b0c4f3801 with scrape type 2
2026-03-28 07:32:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd549500-733e-5e6d-92df-d59b0c4f3801, identifier: LB61549
2026-03-28 07:32:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd549500-733e-5e6d-92df-d59b0c4f3801 with identifier: LB61549
2026-03-28 07:32:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd549500-733e-5e6d-92df-d59b0c4f3801 with identifier: LB61549
2026-03-28 07:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd549500-733e-5e6d-92df-d59b0c4f3801 with identifier: LB61549 to the API
2026-03-28 07:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 389,
'expiration_date': '2026-03-28T16:27:34Z',
'fuel_type': 'petrol',
'id': 'fd549500-733e-5e6d-92df-d59b0c4f3801',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB61549',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 36849,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-22',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 450 Mild-Hybrid 4Matic Exclusive',
'transmission': 'automatic',
'trim': '4Matic Exclusive',
'year': 2022}
2026-03-28 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB61549%27 HTTP/1.1" 200 None
2026-03-28 07:32:25 [auto1.de] INFO: Saving data for LB61549: {'auction_closing_time': 1774715254.0, 'created_time': 1773860180.513595, 'last_price_update_time': 1774683145.899376}
2026-03-28 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB61549') HTTP/1.1" 204 0
2026-03-28 07:32:25 [auto1.de] INFO: Found listing with ID: PU85783
2026-03-28 07:32:25 [auto1.de] INFO: Found listing with ID: XM69109
2026-03-28 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM69109%27 HTTP/1.1" 200 None
2026-03-28 07:32:25 [auto1.de] INFO: Scrape type for XM69109: 2
2026-03-28 07:32:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02f904d3-9236-544f-9b5d-898f18ade3e0 with identifier: XM69109
2026-03-28 07:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02f904d3-9236-544f-9b5d-898f18ade3e0 with scrape type 2
2026-03-28 07:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02f904d3-9236-544f-9b5d-898f18ade3e0 with scrape type 2
2026-03-28 07:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02f904d3-9236-544f-9b5d-898f18ade3e0, identifier: XM69109
2026-03-28 07:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02f904d3-9236-544f-9b5d-898f18ade3e0 with identifier: XM69109
2026-03-28 07:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02f904d3-9236-544f-9b5d-898f18ade3e0 with identifier: XM69109
2026-03-28 07:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02f904d3-9236-544f-9b5d-898f18ade3e0 with identifier: XM69109 to the API
2026-03-28 07:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 280,
'expiration_date': '2026-03-28T16:42:00Z',
'fuel_type': 'petrol',
'id': '02f904d3-9236-544f-9b5d-898f18ade3e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM69109',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra GTC',
'odometer': 99061,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-17',
'seller_name': None,
'title': 'Opel Astra GTC 2.0 Turbo OPC',
'transmission': 'manual',
'trim': 'OPC',
'year': 2014}
2026-03-28 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM69109%27 HTTP/1.1" 200 None
2026-03-28 07:32:26 [auto1.de] INFO: Saving data for XM69109: {'auction_closing_time': 1774716120.0, 'created_time': 1774468094.390588, 'last_price_update_time': 1774683146.331892}
2026-03-28 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM69109') HTTP/1.1" 204 0
2026-03-28 07:32:26 [auto1.de] INFO: Found listing with ID: NU93751
2026-03-28 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU93751%27 HTTP/1.1" 200 None
2026-03-28 07:32:26 [auto1.de] INFO: Scrape type for NU93751: 0
2026-03-28 07:32:26 [auto1.de] INFO: Found listing with ID: JB42175
2026-03-28 07:32:26 [auto1.de] INFO: Found listing with ID: RW58482
2026-03-28 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW58482%27 HTTP/1.1" 200 None
2026-03-28 07:32:26 [auto1.de] INFO: Scrape type for RW58482: 0
2026-03-28 07:32:26 [auto1.de] INFO: Found listing with ID: XJ35206
2026-03-28 07:32:26 [auto1.de] INFO: Found listing with ID: YG99324
2026-03-28 07:32:26 [auto1.de] INFO: Found listing with ID: FJ74613
2026-03-28 07:32:26 [auto1.de] INFO: Found listing with ID: WJ57335
2026-03-28 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ57335%27 HTTP/1.1" 200 None
2026-03-28 07:32:26 [auto1.de] INFO: Scrape type for WJ57335: 0
2026-03-28 07:32:26 [auto1.de] INFO: Found listing with ID: PR99901
2026-03-28 07:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:32:33 [auto1.de] INFO: Channel: 24h | Page: 24 | totalHits: 9250 | hits on page: 40
2026-03-28 07:32:33 [auto1.de] INFO: Found listing with ID: CM46139
2026-03-28 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM46139%27 HTTP/1.1" 200 None
2026-03-28 07:32:33 [auto1.de] INFO: Scrape type for CM46139: 0
2026-03-28 07:32:33 [auto1.de] INFO: Found listing with ID: EJ87927
2026-03-28 07:32:33 [auto1.de] INFO: Found listing with ID: TU83793
2026-03-28 07:32:33 [auto1.de] INFO: Found listing with ID: LE56152
2026-03-28 07:32:33 [auto1.de] INFO: Found listing with ID: TB03254
2026-03-28 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB03254%27 HTTP/1.1" 200 None
2026-03-28 07:32:33 [auto1.de] INFO: Scrape type for TB03254: 0
2026-03-28 07:32:33 [auto1.de] INFO: Found listing with ID: HG55526
2026-03-28 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG55526%27 HTTP/1.1" 200 None
2026-03-28 07:32:33 [auto1.de] INFO: Scrape type for HG55526: 0
2026-03-28 07:32:33 [auto1.de] INFO: Found listing with ID: AJ08614
2026-03-28 07:32:33 [auto1.de] INFO: Found listing with ID: EZ42588
2026-03-28 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ42588%27 HTTP/1.1" 200 None
2026-03-28 07:32:33 [auto1.de] INFO: Scrape type for EZ42588: 0
2026-03-28 07:32:33 [auto1.de] INFO: Found listing with ID: XP66514
2026-03-28 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP66514%27 HTTP/1.1" 200 None
2026-03-28 07:32:33 [auto1.de] INFO: Scrape type for XP66514: 0
2026-03-28 07:32:33 [auto1.de] INFO: Found listing with ID: DL58213
2026-03-28 07:32:33 [auto1.de] INFO: Found listing with ID: AB27737
2026-03-28 07:32:33 [auto1.de] INFO: Found listing with ID: PV43751
2026-03-28 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV43751%27 HTTP/1.1" 200 None
2026-03-28 07:32:33 [auto1.de] INFO: Scrape type for PV43751: 2
2026-03-28 07:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f647bd9-20c2-50c8-933d-704cf144feae with identifier: PV43751
2026-03-28 07:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f647bd9-20c2-50c8-933d-704cf144feae with scrape type 2
2026-03-28 07:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f647bd9-20c2-50c8-933d-704cf144feae with scrape type 2
2026-03-28 07:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f647bd9-20c2-50c8-933d-704cf144feae, identifier: PV43751
2026-03-28 07:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f647bd9-20c2-50c8-933d-704cf144feae with identifier: PV43751
2026-03-28 07:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f647bd9-20c2-50c8-933d-704cf144feae with identifier: PV43751
2026-03-28 07:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f647bd9-20c2-50c8-933d-704cf144feae with identifier: PV43751 to the API
2026-03-28 07:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:24:50Z',
'fuel_type': 'petrol',
'id': '1f647bd9-20c2-50c8-933d-704cf144feae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV43751',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 120755,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-29',
'seller_name': None,
'title': 'Peugeot 308 1.2 e-THP Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2016}
2026-03-28 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV43751%27 HTTP/1.1" 200 None
2026-03-28 07:32:33 [auto1.de] INFO: Saving data for PV43751: {'auction_closing_time': 1774715090.0, 'created_time': 1773859553.920822, 'last_price_update_time': 1774683153.836056}
2026-03-28 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV43751') HTTP/1.1" 204 0
2026-03-28 07:32:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:32:33 [auto1.de] INFO: Found listing with ID: BZ32388
2026-03-28 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ32388%27 HTTP/1.1" 200 None
2026-03-28 07:32:33 [auto1.de] INFO: Scrape type for BZ32388: 0
2026-03-28 07:32:33 [auto1.de] INFO: Found listing with ID: BF01952
2026-03-28 07:32:33 [auto1.de] INFO: Found listing with ID: GR87963
2026-03-28 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR87963%27 HTTP/1.1" 200 None
2026-03-28 07:32:33 [auto1.de] INFO: Scrape type for GR87963: 2
2026-03-28 07:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90ac7e74-c876-5b1d-b665-9c8cf2ecb262 with identifier: GR87963
2026-03-28 07:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90ac7e74-c876-5b1d-b665-9c8cf2ecb262 with scrape type 2
2026-03-28 07:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90ac7e74-c876-5b1d-b665-9c8cf2ecb262 with scrape type 2
2026-03-28 07:32:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90ac7e74-c876-5b1d-b665-9c8cf2ecb262, identifier: GR87963
2026-03-28 07:32:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90ac7e74-c876-5b1d-b665-9c8cf2ecb262 with identifier: GR87963
2026-03-28 07:32:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90ac7e74-c876-5b1d-b665-9c8cf2ecb262 with identifier: GR87963
2026-03-28 07:32:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90ac7e74-c876-5b1d-b665-9c8cf2ecb262 with identifier: GR87963 to the API
2026-03-28 07:32:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:09:21Z',
'fuel_type': 'petrol',
'id': '90ac7e74-c876-5b1d-b665-9c8cf2ecb262',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR87963',
'listing': 'auction',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 76827,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-29',
'seller_name': None,
'title': 'Jeep Renegade 1.3 TGDi Limited 4x2',
'transmission': 'automatic',
'trim': 'Limited 4x2',
'year': 2020}
2026-03-28 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR87963%27 HTTP/1.1" 200 None
2026-03-28 07:32:34 [auto1.de] INFO: Saving data for GR87963: {'auction_closing_time': 1774714161.0, 'created_time': 1773830010.006711, 'last_price_update_time': 1774683154.411326}
2026-03-28 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR87963') HTTP/1.1" 204 0
2026-03-28 07:32:34 [auto1.de] INFO: Found listing with ID: ZJ71499
2026-03-28 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ71499%27 HTTP/1.1" 200 None
2026-03-28 07:32:34 [auto1.de] INFO: Scrape type for ZJ71499: 0
2026-03-28 07:32:34 [auto1.de] INFO: Found listing with ID: GR38931
2026-03-28 07:32:34 [auto1.de] INFO: Found listing with ID: MZ39955
2026-03-28 07:32:34 [auto1.de] INFO: Found listing with ID: WZ89922
2026-03-28 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ89922%27 HTTP/1.1" 200 None
2026-03-28 07:32:34 [auto1.de] INFO: Scrape type for WZ89922: 2
2026-03-28 07:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42235d2c-baee-5d30-b9f5-fdfd503121cf with identifier: WZ89922
2026-03-28 07:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42235d2c-baee-5d30-b9f5-fdfd503121cf with scrape type 2
2026-03-28 07:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42235d2c-baee-5d30-b9f5-fdfd503121cf with scrape type 2
2026-03-28 07:32:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42235d2c-baee-5d30-b9f5-fdfd503121cf, identifier: WZ89922
2026-03-28 07:32:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42235d2c-baee-5d30-b9f5-fdfd503121cf with identifier: WZ89922
2026-03-28 07:32:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42235d2c-baee-5d30-b9f5-fdfd503121cf with identifier: WZ89922
2026-03-28 07:32:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42235d2c-baee-5d30-b9f5-fdfd503121cf with identifier: WZ89922 to the API
2026-03-28 07:32:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:23:35Z',
'fuel_type': 'diesel',
'id': '42235d2c-baee-5d30-b9f5-fdfd503121cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ89922',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 216441,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-17',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
'transmission': 'automatic',
'trim': 'Innovation',
'year': 2016}
2026-03-28 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ89922%27 HTTP/1.1" 200 None
2026-03-28 07:32:34 [auto1.de] INFO: Saving data for WZ89922: {'auction_closing_time': 1774715015.0, 'created_time': 1774466403.716153, 'last_price_update_time': 1774683154.866123}
2026-03-28 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ89922') HTTP/1.1" 204 0
2026-03-28 07:32:34 [auto1.de] INFO: Found listing with ID: HF93741
2026-03-28 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF93741%27 HTTP/1.1" 200 None
2026-03-28 07:32:34 [auto1.de] INFO: Scrape type for HF93741: 0
2026-03-28 07:32:34 [auto1.de] INFO: Found listing with ID: FG55582
2026-03-28 07:32:34 [auto1.de] INFO: Found listing with ID: FX73004
2026-03-28 07:32:34 [auto1.de] INFO: Found listing with ID: MH20468
2026-03-28 07:32:34 [auto1.de] INFO: Found listing with ID: CT28544
2026-03-28 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT28544%27 HTTP/1.1" 200 None
2026-03-28 07:32:34 [auto1.de] INFO: Scrape type for CT28544: 0
2026-03-28 07:32:34 [auto1.de] INFO: Found listing with ID: ZZ22411
2026-03-28 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ22411%27 HTTP/1.1" 200 None
2026-03-28 07:32:34 [auto1.de] INFO: Scrape type for ZZ22411: 2
2026-03-28 07:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cd13770-e3ab-5dd1-a40a-74b445278f11 with identifier: ZZ22411
2026-03-28 07:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cd13770-e3ab-5dd1-a40a-74b445278f11 with scrape type 2
2026-03-28 07:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cd13770-e3ab-5dd1-a40a-74b445278f11 with scrape type 2
2026-03-28 07:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1cd13770-e3ab-5dd1-a40a-74b445278f11, identifier: ZZ22411
2026-03-28 07:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1cd13770-e3ab-5dd1-a40a-74b445278f11 with identifier: ZZ22411
2026-03-28 07:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1cd13770-e3ab-5dd1-a40a-74b445278f11 with identifier: ZZ22411
2026-03-28 07:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1cd13770-e3ab-5dd1-a40a-74b445278f11 with identifier: ZZ22411 to the API
2026-03-28 07:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:56:33Z',
'fuel_type': 'diesel',
'id': '1cd13770-e3ab-5dd1-a40a-74b445278f11',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ22411',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 129947,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-21',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Comfortline 4Motion BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Comfortline 4Motion BlueMotion Tech',
'year': 2017}
2026-03-28 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ22411%27 HTTP/1.1" 200 None
2026-03-28 07:32:35 [auto1.de] INFO: Saving data for ZZ22411: {'auction_closing_time': 1774716993.0, 'created_time': 1774466695.86351, 'last_price_update_time': 1774683155.353403}
2026-03-28 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ22411') HTTP/1.1" 204 0
2026-03-28 07:32:35 [auto1.de] INFO: Found listing with ID: BC32553
2026-03-28 07:32:35 [auto1.de] INFO: Found listing with ID: TR77666
2026-03-28 07:32:35 [auto1.de] INFO: Found listing with ID: AM57263
2026-03-28 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM57263%27 HTTP/1.1" 200 None
2026-03-28 07:32:35 [auto1.de] INFO: Scrape type for AM57263: 0
2026-03-28 07:32:35 [auto1.de] INFO: Found listing with ID: YC31452
2026-03-28 07:32:35 [auto1.de] INFO: Found listing with ID: UT50255
2026-03-28 07:32:35 [auto1.de] INFO: Found listing with ID: TL72428
2026-03-28 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL72428%27 HTTP/1.1" 200 None
2026-03-28 07:32:35 [auto1.de] INFO: Scrape type for TL72428: 0
2026-03-28 07:32:35 [auto1.de] INFO: Found listing with ID: SN29778
2026-03-28 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN29778%27 HTTP/1.1" 200 None
2026-03-28 07:32:35 [auto1.de] INFO: Scrape type for SN29778: 2
2026-03-28 07:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 367216a1-4b0a-53f1-9485-28e0d16d6dcc with identifier: SN29778
2026-03-28 07:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 367216a1-4b0a-53f1-9485-28e0d16d6dcc with scrape type 2
2026-03-28 07:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 367216a1-4b0a-53f1-9485-28e0d16d6dcc with scrape type 2
2026-03-28 07:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 367216a1-4b0a-53f1-9485-28e0d16d6dcc, identifier: SN29778
2026-03-28 07:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 367216a1-4b0a-53f1-9485-28e0d16d6dcc with identifier: SN29778
2026-03-28 07:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 367216a1-4b0a-53f1-9485-28e0d16d6dcc with identifier: SN29778
2026-03-28 07:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 367216a1-4b0a-53f1-9485-28e0d16d6dcc with identifier: SN29778 to the API
2026-03-28 07:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:12:20Z',
'fuel_type': 'petrol',
'id': '367216a1-4b0a-53f1-9485-28e0d16d6dcc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN29778',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 145892,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-30',
'seller_name': None,
'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
'transmission': 'manual',
'trim': 'Stepway Prestige',
'year': 2016}
2026-03-28 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN29778%27 HTTP/1.1" 200 None
2026-03-28 07:32:35 [auto1.de] INFO: Saving data for SN29778: {'auction_closing_time': 1774714340.0, 'created_time': 1774033106.466341, 'last_price_update_time': 1774683155.927835}
2026-03-28 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN29778') HTTP/1.1" 204 0
2026-03-28 07:32:35 [auto1.de] INFO: Found listing with ID: FY31029
2026-03-28 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY31029%27 HTTP/1.1" 200 None
2026-03-28 07:32:35 [auto1.de] INFO: Scrape type for FY31029: 2
2026-03-28 07:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 807cb832-b7db-514c-a416-6057fa695509 with identifier: FY31029
2026-03-28 07:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 807cb832-b7db-514c-a416-6057fa695509 with scrape type 2
2026-03-28 07:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 807cb832-b7db-514c-a416-6057fa695509 with scrape type 2
2026-03-28 07:32:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 807cb832-b7db-514c-a416-6057fa695509, identifier: FY31029
2026-03-28 07:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 807cb832-b7db-514c-a416-6057fa695509 with identifier: FY31029
2026-03-28 07:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 807cb832-b7db-514c-a416-6057fa695509 with identifier: FY31029
2026-03-28 07:32:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 807cb832-b7db-514c-a416-6057fa695509 with identifier: FY31029 to the API
2026-03-28 07:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 210,
'expiration_date': '2026-03-28T16:50:11Z',
'fuel_type': 'petrol',
'id': '807cb832-b7db-514c-a416-6057fa695509',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY31029',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 150130,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-18',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 250 Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2018}
2026-03-28 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY31029%27 HTTP/1.1" 200 None
2026-03-28 07:32:36 [auto1.de] INFO: Saving data for FY31029: {'auction_closing_time': 1774716611.0, 'created_time': 1774466950.097019, 'last_price_update_time': 1774683156.360807}
2026-03-28 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY31029') HTTP/1.1" 204 0
2026-03-28 07:32:36 [auto1.de] INFO: Found listing with ID: NW62557
2026-03-28 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW62557%27 HTTP/1.1" 200 None
2026-03-28 07:32:36 [auto1.de] INFO: Scrape type for NW62557: 0
2026-03-28 07:32:36 [auto1.de] INFO: Found listing with ID: KV92241
2026-03-28 07:32:36 [auto1.de] INFO: Found listing with ID: VE56470
2026-03-28 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE56470%27 HTTP/1.1" 200 None
2026-03-28 07:32:36 [auto1.de] INFO: Scrape type for VE56470: 0
2026-03-28 07:32:36 [auto1.de] INFO: Found listing with ID: ZD16653
2026-03-28 07:32:36 [auto1.de] INFO: Found listing with ID: FL10476
2026-03-28 07:32:36 [auto1.de] INFO: Found listing with ID: FT17472
2026-03-28 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT17472%27 HTTP/1.1" 200 None
2026-03-28 07:32:36 [auto1.de] INFO: Scrape type for FT17472: 0
2026-03-28 07:32:36 [auto1.de] INFO: Found listing with ID: HW55427
2026-03-28 07:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:32:37 [auto1.de] INFO: Channel: 24h | Page: 25 | totalHits: 9250 | hits on page: 40
2026-03-28 07:32:37 [auto1.de] INFO: Found listing with ID: AT91043
2026-03-28 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT91043%27 HTTP/1.1" 200 None
2026-03-28 07:32:37 [auto1.de] INFO: Scrape type for AT91043: 0
2026-03-28 07:32:37 [auto1.de] INFO: Found listing with ID: XU94698
2026-03-28 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU94698%27 HTTP/1.1" 200 None
2026-03-28 07:32:37 [auto1.de] INFO: Scrape type for XU94698: 0
2026-03-28 07:32:37 [auto1.de] INFO: Found listing with ID: HA89318
2026-03-28 07:32:37 [auto1.de] INFO: Found listing with ID: VF29678
2026-03-28 07:32:37 [auto1.de] INFO: Found listing with ID: TX14113
2026-03-28 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX14113%27 HTTP/1.1" 200 None
2026-03-28 07:32:37 [auto1.de] INFO: Scrape type for TX14113: 0
2026-03-28 07:32:37 [auto1.de] INFO: Found listing with ID: HU68643
2026-03-28 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU68643%27 HTTP/1.1" 200 None
2026-03-28 07:32:37 [auto1.de] INFO: Scrape type for HU68643: 0
2026-03-28 07:32:37 [auto1.de] INFO: Found listing with ID: PV13799
2026-03-28 07:32:37 [auto1.de] INFO: Found listing with ID: PJ17742
2026-03-28 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ17742%27 HTTP/1.1" 200 None
2026-03-28 07:32:37 [auto1.de] INFO: Scrape type for PJ17742: 0
2026-03-28 07:32:37 [auto1.de] INFO: Found listing with ID: SV18640
2026-03-28 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV18640%27 HTTP/1.1" 200 None
2026-03-28 07:32:37 [auto1.de] INFO: Scrape type for SV18640: 0
2026-03-28 07:32:37 [auto1.de] INFO: Found listing with ID: DU69800
2026-03-28 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU69800%27 HTTP/1.1" 200 None
2026-03-28 07:32:37 [auto1.de] INFO: Scrape type for DU69800: 0
2026-03-28 07:32:37 [auto1.de] INFO: Found listing with ID: KU76096
2026-03-28 07:32:37 [auto1.de] INFO: Found listing with ID: XM76659
2026-03-28 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM76659%27 HTTP/1.1" 200 None
2026-03-28 07:32:37 [auto1.de] INFO: Scrape type for XM76659: 2
2026-03-28 07:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c1b769d-2425-5a15-a003-c2f8e01567d7 with identifier: XM76659
2026-03-28 07:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c1b769d-2425-5a15-a003-c2f8e01567d7 with scrape type 2
2026-03-28 07:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c1b769d-2425-5a15-a003-c2f8e01567d7 with scrape type 2
2026-03-28 07:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c1b769d-2425-5a15-a003-c2f8e01567d7, identifier: XM76659
2026-03-28 07:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c1b769d-2425-5a15-a003-c2f8e01567d7 with identifier: XM76659
2026-03-28 07:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c1b769d-2425-5a15-a003-c2f8e01567d7 with identifier: XM76659
2026-03-28 07:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c1b769d-2425-5a15-a003-c2f8e01567d7 with identifier: XM76659 to the API
2026-03-28 07:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:30:14Z',
'fuel_type': 'petrol',
'id': '1c1b769d-2425-5a15-a003-c2f8e01567d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM76659',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 112840,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-17',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Sound',
'transmission': 'automatic',
'trim': 'Sound',
'year': 2017}
2026-03-28 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM76659%27 HTTP/1.1" 200 None
2026-03-28 07:32:37 [auto1.de] INFO: Saving data for XM76659: {'auction_closing_time': 1774715414.0, 'created_time': 1774463852.227967, 'last_price_update_time': 1774683157.944247}
2026-03-28 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM76659') HTTP/1.1" 204 0
2026-03-28 07:32:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:32:38 [auto1.de] INFO: Found listing with ID: SD83034
2026-03-28 07:32:38 [auto1.de] INFO: Found listing with ID: NG64881
2026-03-28 07:32:38 [auto1.de] INFO: Found listing with ID: WB57730
2026-03-28 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB57730%27 HTTP/1.1" 200 None
2026-03-28 07:32:38 [auto1.de] INFO: Scrape type for WB57730: 2
2026-03-28 07:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa530bf8-c440-5777-92a4-132cc80e7ea0 with identifier: WB57730
2026-03-28 07:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa530bf8-c440-5777-92a4-132cc80e7ea0 with scrape type 2
2026-03-28 07:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa530bf8-c440-5777-92a4-132cc80e7ea0 with scrape type 2
2026-03-28 07:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa530bf8-c440-5777-92a4-132cc80e7ea0, identifier: WB57730
2026-03-28 07:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa530bf8-c440-5777-92a4-132cc80e7ea0 with identifier: WB57730
2026-03-28 07:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa530bf8-c440-5777-92a4-132cc80e7ea0 with identifier: WB57730
2026-03-28 07:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa530bf8-c440-5777-92a4-132cc80e7ea0 with identifier: WB57730 to the API
2026-03-28 07:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-28T16:47:06Z',
'fuel_type': 'diesel',
'id': 'aa530bf8-c440-5777-92a4-132cc80e7ea0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB57730',
'listing': 'auction',
'make': 'Renault',
'model': 'Koleos',
'odometer': 116065,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-11',
'seller_name': None,
'title': 'Renault Koleos 2.0 dCi Limited',
'transmission': 'automatic',
'trim': 'Limited',
'year': 2019}
2026-03-28 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB57730%27 HTTP/1.1" 200 None
2026-03-28 07:32:38 [auto1.de] INFO: Saving data for WB57730: {'auction_closing_time': 1774716426.0, 'created_time': 1773830279.170189, 'last_price_update_time': 1774683158.479509}
2026-03-28 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB57730') HTTP/1.1" 204 0
2026-03-28 07:32:38 [auto1.de] INFO: Found listing with ID: YF32306
2026-03-28 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF32306%27 HTTP/1.1" 200 None
2026-03-28 07:32:38 [auto1.de] INFO: Scrape type for YF32306: 0
2026-03-28 07:32:38 [auto1.de] INFO: Found listing with ID: TD78857
2026-03-28 07:32:38 [auto1.de] INFO: Found listing with ID: WB68702
2026-03-28 07:32:38 [auto1.de] INFO: Found listing with ID: BK48500
2026-03-28 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK48500%27 HTTP/1.1" 200 None
2026-03-28 07:32:38 [auto1.de] INFO: Scrape type for BK48500: 0
2026-03-28 07:32:38 [auto1.de] INFO: Found listing with ID: TA30581
2026-03-28 07:32:38 [auto1.de] INFO: Found listing with ID: ES90262
2026-03-28 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES90262%27 HTTP/1.1" 200 None
2026-03-28 07:32:38 [auto1.de] INFO: Scrape type for ES90262: 2
2026-03-28 07:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 443dced6-9bc0-5116-9ca9-f5b11a204ad6 with identifier: ES90262
2026-03-28 07:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 443dced6-9bc0-5116-9ca9-f5b11a204ad6 with scrape type 2
2026-03-28 07:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 443dced6-9bc0-5116-9ca9-f5b11a204ad6 with scrape type 2
2026-03-28 07:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 443dced6-9bc0-5116-9ca9-f5b11a204ad6, identifier: ES90262
2026-03-28 07:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 443dced6-9bc0-5116-9ca9-f5b11a204ad6 with identifier: ES90262
2026-03-28 07:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 443dced6-9bc0-5116-9ca9-f5b11a204ad6 with identifier: ES90262
2026-03-28 07:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 443dced6-9bc0-5116-9ca9-f5b11a204ad6 with identifier: ES90262 to the API
2026-03-28 07:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:11:45Z',
'fuel_type': 'petrol',
'id': '443dced6-9bc0-5116-9ca9-f5b11a204ad6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES90262',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 35957,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-13',
'seller_name': None,
'title': 'Renault Twingo 1.0 SCe Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2018}
2026-03-28 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES90262%27 HTTP/1.1" 200 None
2026-03-28 07:32:38 [auto1.de] INFO: Saving data for ES90262: {'auction_closing_time': 1774714305.0, 'created_time': 1773829968.387418, 'last_price_update_time': 1774683158.930334}
2026-03-28 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES90262') HTTP/1.1" 204 0
2026-03-28 07:32:38 [auto1.de] INFO: Found listing with ID: KH17356
2026-03-28 07:32:38 [auto1.de] INFO: Found listing with ID: KG51970
2026-03-28 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG51970%27 HTTP/1.1" 200 None
2026-03-28 07:32:38 [auto1.de] INFO: Scrape type for KG51970: 0
2026-03-28 07:32:38 [auto1.de] INFO: Found listing with ID: RT76696
2026-03-28 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT76696%27 HTTP/1.1" 200 None
2026-03-28 07:32:38 [auto1.de] INFO: Scrape type for RT76696: 0
2026-03-28 07:32:38 [auto1.de] INFO: Found listing with ID: XL57324
2026-03-28 07:32:38 [auto1.de] INFO: Found listing with ID: GJ82118
2026-03-28 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ82118%27 HTTP/1.1" 200 None
2026-03-28 07:32:39 [auto1.de] INFO: Scrape type for GJ82118: 0
2026-03-28 07:32:39 [auto1.de] INFO: Found listing with ID: PK52215
2026-03-28 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK52215%27 HTTP/1.1" 200 None
2026-03-28 07:32:39 [auto1.de] INFO: Scrape type for PK52215: 2
2026-03-28 07:32:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ca6e7b0-c686-5882-9013-2750822e88ed with identifier: PK52215
2026-03-28 07:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ca6e7b0-c686-5882-9013-2750822e88ed with scrape type 2
2026-03-28 07:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ca6e7b0-c686-5882-9013-2750822e88ed with scrape type 2
2026-03-28 07:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ca6e7b0-c686-5882-9013-2750822e88ed, identifier: PK52215
2026-03-28 07:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ca6e7b0-c686-5882-9013-2750822e88ed with identifier: PK52215
2026-03-28 07:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ca6e7b0-c686-5882-9013-2750822e88ed with identifier: PK52215
2026-03-28 07:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ca6e7b0-c686-5882-9013-2750822e88ed with identifier: PK52215 to the API
2026-03-28 07:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:58:35Z',
'fuel_type': 'petrol',
'id': '4ca6e7b0-c686-5882-9013-2750822e88ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK52215',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kamiq',
'odometer': 220198,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-14',
'seller_name': None,
'title': 'Skoda Kamiq 1.0 TSI ScoutLine',
'transmission': 'automatic',
'trim': 'ScoutLine',
'year': 2022}
2026-03-28 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK52215%27 HTTP/1.1" 200 None
2026-03-28 07:32:39 [auto1.de] INFO: Saving data for PK52215: {'auction_closing_time': 1774717115.0, 'created_time': 1774468186.617188, 'last_price_update_time': 1774683159.463856}
2026-03-28 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK52215') HTTP/1.1" 204 0
2026-03-28 07:32:39 [auto1.de] INFO: Found listing with ID: SV40404
2026-03-28 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV40404%27 HTTP/1.1" 200 None
2026-03-28 07:32:39 [auto1.de] INFO: Scrape type for SV40404: 0
2026-03-28 07:32:39 [auto1.de] INFO: Found listing with ID: WH62381
2026-03-28 07:32:39 [auto1.de] INFO: Found listing with ID: AG00767
2026-03-28 07:32:39 [auto1.de] INFO: Found listing with ID: GJ42826
2026-03-28 07:32:39 [auto1.de] INFO: Found listing with ID: EL91919
2026-03-28 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL91919%27 HTTP/1.1" 200 None
2026-03-28 07:32:39 [auto1.de] INFO: Scrape type for EL91919: 0
2026-03-28 07:32:39 [auto1.de] INFO: Found listing with ID: PK45675
2026-03-28 07:32:39 [auto1.de] INFO: Found listing with ID: ZR88631
2026-03-28 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR88631%27 HTTP/1.1" 200 None
2026-03-28 07:32:39 [auto1.de] INFO: Scrape type for ZR88631: 0
2026-03-28 07:32:39 [auto1.de] INFO: Found listing with ID: AD17341
2026-03-28 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD17341%27 HTTP/1.1" 200 None
2026-03-28 07:32:39 [auto1.de] INFO: Scrape type for AD17341: 0
2026-03-28 07:32:39 [auto1.de] INFO: Found listing with ID: DY66816
2026-03-28 07:32:39 [auto1.de] INFO: Found listing with ID: TS73841
2026-03-28 07:32:39 [auto1.de] INFO: Found listing with ID: KZ47858
2026-03-28 07:32:39 [auto1.de] INFO: Found listing with ID: HD30169
2026-03-28 07:32:39 [auto1.de] INFO: Found listing with ID: ZR29667
2026-03-28 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR29667%27 HTTP/1.1" 200 None
2026-03-28 07:32:39 [auto1.de] INFO: Scrape type for ZR29667: 0
2026-03-28 07:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:32:40 [auto1.de] INFO: Channel: 24h | Page: 26 | totalHits: 9250 | hits on page: 40
2026-03-28 07:32:40 [auto1.de] INFO: Found listing with ID: PR18701
2026-03-28 07:32:40 [auto1.de] INFO: Found listing with ID: NZ20734
2026-03-28 07:32:40 [auto1.de] INFO: Found listing with ID: CR46932
2026-03-28 07:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR46932%27 HTTP/1.1" 200 None
2026-03-28 07:32:40 [auto1.de] INFO: Scrape type for CR46932: 0
2026-03-28 07:32:40 [auto1.de] INFO: Found listing with ID: UP49415
2026-03-28 07:32:40 [auto1.de] INFO: Found listing with ID: RB81159
2026-03-28 07:32:40 [auto1.de] INFO: Found listing with ID: GD15410
2026-03-28 07:32:40 [auto1.de] INFO: Found listing with ID: MZ83474
2026-03-28 07:32:40 [auto1.de] INFO: Found listing with ID: SU75801
2026-03-28 07:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU75801%27 HTTP/1.1" 200 None
2026-03-28 07:32:40 [auto1.de] INFO: Scrape type for SU75801: 2
2026-03-28 07:32:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b679182c-6aaa-5b06-a8c5-2e8a647f14e6 with identifier: SU75801
2026-03-28 07:32:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b679182c-6aaa-5b06-a8c5-2e8a647f14e6 with scrape type 2
2026-03-28 07:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b679182c-6aaa-5b06-a8c5-2e8a647f14e6 with scrape type 2
2026-03-28 07:32:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b679182c-6aaa-5b06-a8c5-2e8a647f14e6, identifier: SU75801
2026-03-28 07:32:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b679182c-6aaa-5b06-a8c5-2e8a647f14e6 with identifier: SU75801
2026-03-28 07:32:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b679182c-6aaa-5b06-a8c5-2e8a647f14e6 with identifier: SU75801
2026-03-28 07:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b679182c-6aaa-5b06-a8c5-2e8a647f14e6 with identifier: SU75801 to the API
2026-03-28 07:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:52:19Z',
'fuel_type': 'petrol',
'id': 'b679182c-6aaa-5b06-a8c5-2e8a647f14e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU75801',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 96225,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-25',
'seller_name': None,
'title': 'Seat Leon 1.4 TSI ACT FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2014}
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU75801%27 HTTP/1.1" 200 None
2026-03-28 07:32:42 [auto1.de] INFO: Saving data for SU75801: {'auction_closing_time': 1774716739.0, 'created_time': 1774466199.696263, 'last_price_update_time': 1774683162.138609}
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU75801') HTTP/1.1" 204 0
2026-03-28 07:32:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: HZ20849
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ20849%27 HTTP/1.1" 200 None
2026-03-28 07:32:42 [auto1.de] INFO: Scrape type for HZ20849: 0
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: EV62209
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: TY59388
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY59388%27 HTTP/1.1" 200 None
2026-03-28 07:32:42 [auto1.de] INFO: Scrape type for TY59388: 2
2026-03-28 07:32:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 260b6a58-a445-53ce-95e0-183c2aad95c8 with identifier: TY59388
2026-03-28 07:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 260b6a58-a445-53ce-95e0-183c2aad95c8 with scrape type 2
2026-03-28 07:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 260b6a58-a445-53ce-95e0-183c2aad95c8 with scrape type 2
2026-03-28 07:32:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 260b6a58-a445-53ce-95e0-183c2aad95c8, identifier: TY59388
2026-03-28 07:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 260b6a58-a445-53ce-95e0-183c2aad95c8 with identifier: TY59388
2026-03-28 07:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 260b6a58-a445-53ce-95e0-183c2aad95c8 with identifier: TY59388
2026-03-28 07:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 260b6a58-a445-53ce-95e0-183c2aad95c8 with identifier: TY59388 to the API
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 145,
'expiration_date': '2026-03-28T16:14:57Z',
'fuel_type': 'petrol',
'id': '260b6a58-a445-53ce-95e0-183c2aad95c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY59388',
'listing': 'auction',
'make': 'Mazda',
'model': '5',
'odometer': 168290,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-31',
'seller_name': None,
'title': 'Mazda 5 2.0 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2010}
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY59388%27 HTTP/1.1" 200 None
2026-03-28 07:32:42 [auto1.de] INFO: Saving data for TY59388: {'auction_closing_time': 1774714497.0, 'created_time': 1774467925.151257, 'last_price_update_time': 1774683162.676964}
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY59388') HTTP/1.1" 204 0
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: LG76747
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: WL38814
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL38814%27 HTTP/1.1" 200 None
2026-03-28 07:32:42 [auto1.de] INFO: Scrape type for WL38814: 0
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: DK33698
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: FR53329
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: TB85730
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB85730%27 HTTP/1.1" 200 None
2026-03-28 07:32:42 [auto1.de] INFO: Scrape type for TB85730: 0
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: UV62797
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV62797%27 HTTP/1.1" 200 None
2026-03-28 07:32:42 [auto1.de] INFO: Scrape type for UV62797: 0
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: UK70882
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK70882%27 HTTP/1.1" 200 None
2026-03-28 07:32:42 [auto1.de] INFO: Scrape type for UK70882: 0
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: SV36392
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: EU33293
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: KU48323
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: KY16497
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY16497%27 HTTP/1.1" 200 None
2026-03-28 07:32:42 [auto1.de] INFO: Scrape type for KY16497: 0
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: KG98578
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG98578%27 HTTP/1.1" 200 None
2026-03-28 07:32:42 [auto1.de] INFO: Scrape type for KG98578: 0
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: GC23604
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: PY07477
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY07477%27 HTTP/1.1" 200 None
2026-03-28 07:32:42 [auto1.de] INFO: Scrape type for PY07477: 0
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: LU02094
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: XH29629
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: YY96665
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: GJ62462
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ62462%27 HTTP/1.1" 200 None
2026-03-28 07:32:42 [auto1.de] INFO: Scrape type for GJ62462: 0
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: SC48990
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC48990%27 HTTP/1.1" 200 None
2026-03-28 07:32:42 [auto1.de] INFO: Scrape type for SC48990: 0
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: LW43153
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: LP76245
2026-03-28 07:32:42 [auto1.de] INFO: Found listing with ID: CZ59156
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ59156%27 HTTP/1.1" 200 None
2026-03-28 07:32:42 [auto1.de] INFO: Scrape type for CZ59156: 2
2026-03-28 07:32:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 479be3d0-fd71-5bd6-ac6a-64ea54f9c9f1 with identifier: CZ59156
2026-03-28 07:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 479be3d0-fd71-5bd6-ac6a-64ea54f9c9f1 with scrape type 2
2026-03-28 07:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 479be3d0-fd71-5bd6-ac6a-64ea54f9c9f1 with scrape type 2
2026-03-28 07:32:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 479be3d0-fd71-5bd6-ac6a-64ea54f9c9f1, identifier: CZ59156
2026-03-28 07:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 479be3d0-fd71-5bd6-ac6a-64ea54f9c9f1 with identifier: CZ59156
2026-03-28 07:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 479be3d0-fd71-5bd6-ac6a-64ea54f9c9f1 with identifier: CZ59156
2026-03-28 07:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 479be3d0-fd71-5bd6-ac6a-64ea54f9c9f1 with identifier: CZ59156 to the API
2026-03-28 07:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:47:40Z',
'fuel_type': 'petrol',
'id': '479be3d0-fd71-5bd6-ac6a-64ea54f9c9f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ59156',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 142147,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-07-12',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2006}
2026-03-28 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ59156%27 HTTP/1.1" 200 None
2026-03-28 07:32:43 [auto1.de] INFO: Saving data for CZ59156: {'auction_closing_time': 1774716460.0, 'created_time': 1774466976.766228, 'last_price_update_time': 1774683163.251675}
2026-03-28 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ59156') HTTP/1.1" 204 0
2026-03-28 07:32:43 [auto1.de] INFO: Found listing with ID: NG39570
2026-03-28 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG39570%27 HTTP/1.1" 200 None
2026-03-28 07:32:43 [auto1.de] INFO: Scrape type for NG39570: 0
2026-03-28 07:32:43 [auto1.de] INFO: Found listing with ID: DE61416
2026-03-28 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE61416%27 HTTP/1.1" 200 None
2026-03-28 07:32:43 [auto1.de] INFO: Scrape type for DE61416: 0
2026-03-28 07:32:43 [auto1.de] INFO: Found listing with ID: WS48624
2026-03-28 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48624%27 HTTP/1.1" 200 None
2026-03-28 07:32:43 [auto1.de] INFO: Scrape type for WS48624: 0
2026-03-28 07:32:43 [auto1.de] INFO: Found listing with ID: EG31023
2026-03-28 07:32:43 [auto1.de] INFO: Found listing with ID: DA75370
2026-03-28 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA75370%27 HTTP/1.1" 200 None
2026-03-28 07:32:43 [auto1.de] INFO: Scrape type for DA75370: 0
2026-03-28 07:32:43 [auto1.de] INFO: Found listing with ID: TV36332
2026-03-28 07:32:43 [auto1.de] INFO: Found listing with ID: YS83554
2026-03-28 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS83554%27 HTTP/1.1" 200 None
2026-03-28 07:32:43 [auto1.de] INFO: Scrape type for YS83554: 0
2026-03-28 07:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:32:44 [auto1.de] INFO: Channel: 24h | Page: 27 | totalHits: 9250 | hits on page: 40
2026-03-28 07:32:44 [auto1.de] INFO: Found listing with ID: MU75641
2026-03-28 07:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU75641%27 HTTP/1.1" 200 None
2026-03-28 07:32:44 [auto1.de] INFO: Scrape type for MU75641: 0
2026-03-28 07:32:44 [auto1.de] INFO: Found listing with ID: SD07128
2026-03-28 07:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD07128%27 HTTP/1.1" 200 None
2026-03-28 07:32:44 [auto1.de] INFO: Scrape type for SD07128: 2
2026-03-28 07:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51d0f9cc-dec1-5b02-989a-9f28c4d7f3f7 with identifier: SD07128
2026-03-28 07:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51d0f9cc-dec1-5b02-989a-9f28c4d7f3f7 with scrape type 2
2026-03-28 07:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51d0f9cc-dec1-5b02-989a-9f28c4d7f3f7 with scrape type 2
2026-03-28 07:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 51d0f9cc-dec1-5b02-989a-9f28c4d7f3f7, identifier: SD07128
2026-03-28 07:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 51d0f9cc-dec1-5b02-989a-9f28c4d7f3f7 with identifier: SD07128
2026-03-28 07:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 51d0f9cc-dec1-5b02-989a-9f28c4d7f3f7 with identifier: SD07128
2026-03-28 07:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 51d0f9cc-dec1-5b02-989a-9f28c4d7f3f7 with identifier: SD07128 to the API
2026-03-28 07:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-28T16:10:19Z',
'fuel_type': 'petrol',
'id': '51d0f9cc-dec1-5b02-989a-9f28c4d7f3f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD07128',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 82964,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-10',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2009}
2026-03-28 07:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD07128%27 HTTP/1.1" 200 None
2026-03-28 07:32:44 [auto1.de] INFO: Saving data for SD07128: {'auction_closing_time': 1774714219.0, 'created_time': 1774466698.812761, 'last_price_update_time': 1774683164.77852}
2026-03-28 07:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD07128') HTTP/1.1" 204 0
2026-03-28 07:32:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:32:44 [auto1.de] INFO: Found listing with ID: GF78107
2026-03-28 07:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF78107%27 HTTP/1.1" 200 None
2026-03-28 07:32:44 [auto1.de] INFO: Scrape type for GF78107: 0
2026-03-28 07:32:44 [auto1.de] INFO: Found listing with ID: MM98410
2026-03-28 07:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM98410%27 HTTP/1.1" 200 None
2026-03-28 07:32:44 [auto1.de] INFO: Scrape type for MM98410: 2
2026-03-28 07:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e2acefe-b77b-55fd-ba68-beb206535018 with identifier: MM98410
2026-03-28 07:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e2acefe-b77b-55fd-ba68-beb206535018 with scrape type 2
2026-03-28 07:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e2acefe-b77b-55fd-ba68-beb206535018 with scrape type 2
2026-03-28 07:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e2acefe-b77b-55fd-ba68-beb206535018, identifier: MM98410
2026-03-28 07:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e2acefe-b77b-55fd-ba68-beb206535018 with identifier: MM98410
2026-03-28 07:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e2acefe-b77b-55fd-ba68-beb206535018 with identifier: MM98410
2026-03-28 07:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e2acefe-b77b-55fd-ba68-beb206535018 with identifier: MM98410 to the API
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:05:49Z',
'fuel_type': 'petrol',
'id': '4e2acefe-b77b-55fd-ba68-beb206535018',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM98410',
'listing': 'auction',
'make': 'Jeep',
'model': 'Compass',
'odometer': 136811,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-31',
'seller_name': None,
'title': 'Jeep Compass 2.4 Limited',
'transmission': 'automatic',
'trim': 'Limited',
'year': 2009}
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM98410%27 HTTP/1.1" 200 None
2026-03-28 07:32:45 [auto1.de] INFO: Saving data for MM98410: {'auction_closing_time': 1774713949.0, 'created_time': 1773859483.869231, 'last_price_update_time': 1774683165.205823}
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM98410') HTTP/1.1" 204 0
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: VE08810
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: FL49521
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: NT88605
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT88605%27 HTTP/1.1" 200 None
2026-03-28 07:32:45 [auto1.de] INFO: Scrape type for NT88605: 0
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: NF88064
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: LP44310
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: HX92939
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: AC43981
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: MC69787
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: CR20682
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: NS29449
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS29449%27 HTTP/1.1" 200 None
2026-03-28 07:32:45 [auto1.de] INFO: Scrape type for NS29449: 0
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: CL87720
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: ER86835
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER86835%27 HTTP/1.1" 200 None
2026-03-28 07:32:45 [auto1.de] INFO: Scrape type for ER86835: 0
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: MH03365
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: NV55096
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: AM83584
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: AT28488
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT28488%27 HTTP/1.1" 200 None
2026-03-28 07:32:45 [auto1.de] INFO: Scrape type for AT28488: 0
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: WK50134
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK50134%27 HTTP/1.1" 200 None
2026-03-28 07:32:45 [auto1.de] INFO: Scrape type for WK50134: 0
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: VS58629
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: KV33048
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: SU06279
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU06279%27 HTTP/1.1" 200 None
2026-03-28 07:32:45 [auto1.de] INFO: Scrape type for SU06279: 0
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: WA59157
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA59157%27 HTTP/1.1" 200 None
2026-03-28 07:32:45 [auto1.de] INFO: Scrape type for WA59157: 0
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: HX55522
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: NY15812
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY15812%27 HTTP/1.1" 200 None
2026-03-28 07:32:45 [auto1.de] INFO: Scrape type for NY15812: 0
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: TH25711
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH25711%27 HTTP/1.1" 200 None
2026-03-28 07:32:45 [auto1.de] INFO: Scrape type for TH25711: 0
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: AM43166
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: ZX12399
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: TW04232
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: FV21228
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: RG95107
2026-03-28 07:32:45 [auto1.de] INFO: Found listing with ID: LX91307
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX91307%27 HTTP/1.1" 200 None
2026-03-28 07:32:45 [auto1.de] INFO: Scrape type for LX91307: 2
2026-03-28 07:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a477771-29c1-536d-98a8-282d88a5be9a with identifier: LX91307
2026-03-28 07:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a477771-29c1-536d-98a8-282d88a5be9a with scrape type 2
2026-03-28 07:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a477771-29c1-536d-98a8-282d88a5be9a with scrape type 2
2026-03-28 07:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a477771-29c1-536d-98a8-282d88a5be9a, identifier: LX91307
2026-03-28 07:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a477771-29c1-536d-98a8-282d88a5be9a with identifier: LX91307
2026-03-28 07:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a477771-29c1-536d-98a8-282d88a5be9a with identifier: LX91307
2026-03-28 07:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a477771-29c1-536d-98a8-282d88a5be9a with identifier: LX91307 to the API
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 292,
'expiration_date': '2026-03-28T16:36:09Z',
'fuel_type': 'diesel',
'id': '1a477771-29c1-536d-98a8-282d88a5be9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX91307',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 54426,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-11',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 300 d Mild-Hybrid 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2023}
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX91307%27 HTTP/1.1" 200 None
2026-03-28 07:32:45 [auto1.de] INFO: Saving data for LX91307: {'auction_closing_time': 1774715769.0, 'created_time': 1774032327.861121, 'last_price_update_time': 1774683165.885347}
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX91307') HTTP/1.1" 204 0
2026-03-28 07:32:46 [auto1.de] INFO: Found listing with ID: ZU57618
2026-03-28 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU57618%27 HTTP/1.1" 200 None
2026-03-28 07:32:46 [auto1.de] INFO: Scrape type for ZU57618: 0
2026-03-28 07:32:46 [auto1.de] INFO: Found listing with ID: FG34327
2026-03-28 07:32:46 [auto1.de] INFO: Found listing with ID: BJ20331
2026-03-28 07:32:46 [auto1.de] INFO: Found listing with ID: TX55902
2026-03-28 07:32:46 [auto1.de] INFO: Found listing with ID: RN76659
2026-03-28 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN76659%27 HTTP/1.1" 200 None
2026-03-28 07:32:46 [auto1.de] INFO: Scrape type for RN76659: 0
2026-03-28 07:32:46 [auto1.de] INFO: Found listing with ID: TL28504
2026-03-28 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL28504%27 HTTP/1.1" 200 None
2026-03-28 07:32:46 [auto1.de] INFO: Scrape type for TL28504: 0
2026-03-28 07:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:32:47 [auto1.de] INFO: Channel: 24h | Page: 28 | totalHits: 9250 | hits on page: 40
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: WV72742
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: BP63027
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: LB03108
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: ED43113
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: UC27013
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: NE71450
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE71450%27 HTTP/1.1" 200 None
2026-03-28 07:32:47 [auto1.de] INFO: Scrape type for NE71450: 0
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: JK54144
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK54144%27 HTTP/1.1" 200 None
2026-03-28 07:32:47 [auto1.de] INFO: Scrape type for JK54144: 0
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: GY35476
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: LU41152
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU41152%27 HTTP/1.1" 200 None
2026-03-28 07:32:47 [auto1.de] INFO: Scrape type for LU41152: 0
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: AP94467
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: YL58691
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL58691%27 HTTP/1.1" 200 None
2026-03-28 07:32:47 [auto1.de] INFO: Scrape type for YL58691: 0
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: TW29404
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: BC27569
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC27569%27 HTTP/1.1" 200 None
2026-03-28 07:32:47 [auto1.de] INFO: Scrape type for BC27569: 0
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: HY08427
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY08427%27 HTTP/1.1" 200 None
2026-03-28 07:32:47 [auto1.de] INFO: Scrape type for HY08427: 0
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: AN50976
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN50976%27 HTTP/1.1" 200 None
2026-03-28 07:32:47 [auto1.de] INFO: Scrape type for AN50976: 0
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: ES83380
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: WR22975
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR22975%27 HTTP/1.1" 200 None
2026-03-28 07:32:47 [auto1.de] INFO: Scrape type for WR22975: 0
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: VE57105
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: XB15869
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: FV65723
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: SH65641
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH65641%27 HTTP/1.1" 200 None
2026-03-28 07:32:47 [auto1.de] INFO: Scrape type for SH65641: 0
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: AP13517
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: UJ62660
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ62660%27 HTTP/1.1" 200 None
2026-03-28 07:32:47 [auto1.de] INFO: Scrape type for UJ62660: 0
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: HW53715
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW53715%27 HTTP/1.1" 200 None
2026-03-28 07:32:47 [auto1.de] INFO: Scrape type for HW53715: 0
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: DX03120
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX03120%27 HTTP/1.1" 200 None
2026-03-28 07:32:47 [auto1.de] INFO: Scrape type for DX03120: 0
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: DV26733
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: BW33957
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW33957%27 HTTP/1.1" 200 None
2026-03-28 07:32:47 [auto1.de] INFO: Scrape type for BW33957: 0
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: MK42970
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: UA59950
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA59950%27 HTTP/1.1" 200 None
2026-03-28 07:32:47 [auto1.de] INFO: Scrape type for UA59950: 0
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: CT75216
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT75216%27 HTTP/1.1" 200 None
2026-03-28 07:32:47 [auto1.de] INFO: Scrape type for CT75216: 0
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: DS83303
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: SR06825
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: GC30442
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC30442%27 HTTP/1.1" 200 None
2026-03-28 07:32:47 [auto1.de] INFO: Scrape type for GC30442: 0
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: VC88612
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: FH53485
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: NY19608
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: WX33301
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: YD46257
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD46257%27 HTTP/1.1" 200 None
2026-03-28 07:32:47 [auto1.de] INFO: Scrape type for YD46257: 0
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: XP10598
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP10598%27 HTTP/1.1" 200 None
2026-03-28 07:32:47 [auto1.de] INFO: Scrape type for XP10598: 0
2026-03-28 07:32:47 [auto1.de] INFO: Found listing with ID: FJ03790
2026-03-28 07:32:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:32:48 [auto1.de] INFO: Channel: 24h | Page: 29 | totalHits: 9250 | hits on page: 40
2026-03-28 07:32:48 [auto1.de] INFO: Found listing with ID: ZU04688
2026-03-28 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU04688%27 HTTP/1.1" 200 None
2026-03-28 07:32:48 [auto1.de] INFO: Scrape type for ZU04688: 0
2026-03-28 07:32:48 [auto1.de] INFO: Found listing with ID: HX25760
2026-03-28 07:32:48 [auto1.de] INFO: Found listing with ID: DG36538
2026-03-28 07:32:48 [auto1.de] INFO: Found listing with ID: RP88862
2026-03-28 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP88862%27 HTTP/1.1" 200 None
2026-03-28 07:32:48 [auto1.de] INFO: Scrape type for RP88862: 0
2026-03-28 07:32:48 [auto1.de] INFO: Found listing with ID: KG08192
2026-03-28 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG08192%27 HTTP/1.1" 200 None
2026-03-28 07:32:48 [auto1.de] INFO: Scrape type for KG08192: 0
2026-03-28 07:32:48 [auto1.de] INFO: Found listing with ID: VM73254
2026-03-28 07:32:48 [auto1.de] INFO: Found listing with ID: AM33807
2026-03-28 07:32:48 [auto1.de] INFO: Found listing with ID: AN43216
2026-03-28 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN43216%27 HTTP/1.1" 200 None
2026-03-28 07:32:48 [auto1.de] INFO: Scrape type for AN43216: 0
2026-03-28 07:32:48 [auto1.de] INFO: Found listing with ID: CX50338
2026-03-28 07:32:48 [auto1.de] INFO: Found listing with ID: EU22008
2026-03-28 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU22008%27 HTTP/1.1" 200 None
2026-03-28 07:32:48 [auto1.de] INFO: Scrape type for EU22008: 0
2026-03-28 07:32:48 [auto1.de] INFO: Found listing with ID: BX09216
2026-03-28 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX09216%27 HTTP/1.1" 200 None
2026-03-28 07:32:48 [auto1.de] INFO: Scrape type for BX09216: 0
2026-03-28 07:32:48 [auto1.de] INFO: Found listing with ID: VY02082
2026-03-28 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY02082%27 HTTP/1.1" 200 None
2026-03-28 07:32:48 [auto1.de] INFO: Scrape type for VY02082: 0
2026-03-28 07:32:48 [auto1.de] INFO: Found listing with ID: ZD44688
2026-03-28 07:32:48 [auto1.de] INFO: Found listing with ID: UD17683
2026-03-28 07:32:48 [auto1.de] INFO: Found listing with ID: XD99934
2026-03-28 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD99934%27 HTTP/1.1" 200 None
2026-03-28 07:32:48 [auto1.de] INFO: Scrape type for XD99934: 2
2026-03-28 07:32:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b2dca11-9a2e-55b5-b4be-ca980f402dfc with identifier: XD99934
2026-03-28 07:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b2dca11-9a2e-55b5-b4be-ca980f402dfc with scrape type 2
2026-03-28 07:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b2dca11-9a2e-55b5-b4be-ca980f402dfc with scrape type 2
2026-03-28 07:32:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b2dca11-9a2e-55b5-b4be-ca980f402dfc, identifier: XD99934
2026-03-28 07:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b2dca11-9a2e-55b5-b4be-ca980f402dfc with identifier: XD99934
2026-03-28 07:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b2dca11-9a2e-55b5-b4be-ca980f402dfc with identifier: XD99934
2026-03-28 07:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b2dca11-9a2e-55b5-b4be-ca980f402dfc with identifier: XD99934 to the API
2026-03-28 07:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:02:52Z',
'fuel_type': 'petrol',
'id': '9b2dca11-9a2e-55b5-b4be-ca980f402dfc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD99934',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 112175,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-08',
'seller_name': None,
'title': 'Ford Mondeo 1.0 EcoBoost Business Edition',
'transmission': 'manual',
'trim': 'Business Edition',
'year': 2016}
2026-03-28 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD99934%27 HTTP/1.1" 200 None
2026-03-28 07:32:49 [auto1.de] INFO: Saving data for XD99934: {'auction_closing_time': 1774713772.0, 'created_time': 1774464738.643874, 'last_price_update_time': 1774683169.264071}
2026-03-28 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD99934') HTTP/1.1" 204 0
2026-03-28 07:32:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:32:49 [auto1.de] INFO: Found listing with ID: SD42859
2026-03-28 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD42859%27 HTTP/1.1" 200 None
2026-03-28 07:32:49 [auto1.de] INFO: Scrape type for SD42859: 2
2026-03-28 07:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cccb45b-7aa1-5a84-9faa-d692f6d5e461 with identifier: SD42859
2026-03-28 07:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cccb45b-7aa1-5a84-9faa-d692f6d5e461 with scrape type 2
2026-03-28 07:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cccb45b-7aa1-5a84-9faa-d692f6d5e461 with scrape type 2
2026-03-28 07:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6cccb45b-7aa1-5a84-9faa-d692f6d5e461, identifier: SD42859
2026-03-28 07:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6cccb45b-7aa1-5a84-9faa-d692f6d5e461 with identifier: SD42859
2026-03-28 07:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6cccb45b-7aa1-5a84-9faa-d692f6d5e461 with identifier: SD42859
2026-03-28 07:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6cccb45b-7aa1-5a84-9faa-d692f6d5e461 with identifier: SD42859 to the API
2026-03-28 07:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:45:48Z',
'fuel_type': 'petrol',
'id': '6cccb45b-7aa1-5a84-9faa-d692f6d5e461',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD42859',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 92480,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-10',
'seller_name': None,
'title': 'Skoda Fabia 1.0 TSI Soleil',
'transmission': 'manual',
'trim': 'Soleil',
'year': 2019}
2026-03-28 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD42859%27 HTTP/1.1" 200 None
2026-03-28 07:32:49 [auto1.de] INFO: Saving data for SD42859: {'auction_closing_time': 1774716348.0, 'created_time': 1774468031.641253, 'last_price_update_time': 1774683169.851375}
2026-03-28 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD42859') HTTP/1.1" 204 0
2026-03-28 07:32:49 [auto1.de] INFO: Found listing with ID: TY49191
2026-03-28 07:32:49 [auto1.de] INFO: Found listing with ID: SH18397
2026-03-28 07:32:49 [auto1.de] INFO: Found listing with ID: XS25100
2026-03-28 07:32:49 [auto1.de] INFO: Found listing with ID: SB37681
2026-03-28 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB37681%27 HTTP/1.1" 200 None
2026-03-28 07:32:49 [auto1.de] INFO: Scrape type for SB37681: 0
2026-03-28 07:32:49 [auto1.de] INFO: Found listing with ID: UK63954
2026-03-28 07:32:49 [auto1.de] INFO: Found listing with ID: VT99201
2026-03-28 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT99201%27 HTTP/1.1" 200 None
2026-03-28 07:32:49 [auto1.de] INFO: Scrape type for VT99201: 2
2026-03-28 07:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec49cfac-6a6a-51ae-96ce-076bbc131024 with identifier: VT99201
2026-03-28 07:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec49cfac-6a6a-51ae-96ce-076bbc131024 with scrape type 2
2026-03-28 07:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec49cfac-6a6a-51ae-96ce-076bbc131024 with scrape type 2
2026-03-28 07:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec49cfac-6a6a-51ae-96ce-076bbc131024, identifier: VT99201
2026-03-28 07:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec49cfac-6a6a-51ae-96ce-076bbc131024 with identifier: VT99201
2026-03-28 07:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec49cfac-6a6a-51ae-96ce-076bbc131024 with identifier: VT99201
2026-03-28 07:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec49cfac-6a6a-51ae-96ce-076bbc131024 with identifier: VT99201 to the API
2026-03-28 07:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:32:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:53:04Z',
'fuel_type': 'petrol',
'id': 'ec49cfac-6a6a-51ae-96ce-076bbc131024',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT99201',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 118427,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-01',
'seller_name': None,
'title': 'BMW 1er 116i Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2017}
2026-03-28 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT99201%27 HTTP/1.1" 200 None
2026-03-28 07:32:50 [auto1.de] INFO: Saving data for VT99201: {'auction_closing_time': 1774716784.0, 'created_time': 1774465907.097501, 'last_price_update_time': 1774683170.324189}
2026-03-28 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT99201') HTTP/1.1" 204 0
2026-03-28 07:32:50 [auto1.de] INFO: Found listing with ID: SR45801
2026-03-28 07:32:50 [auto1.de] INFO: Found listing with ID: DW68578
2026-03-28 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW68578%27 HTTP/1.1" 200 None
2026-03-28 07:32:50 [auto1.de] INFO: Scrape type for DW68578: 0
2026-03-28 07:32:50 [auto1.de] INFO: Found listing with ID: NY59732
2026-03-28 07:32:50 [auto1.de] INFO: Found listing with ID: XZ76786
2026-03-28 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ76786%27 HTTP/1.1" 200 None
2026-03-28 07:32:50 [auto1.de] INFO: Scrape type for XZ76786: 0
2026-03-28 07:32:50 [auto1.de] INFO: Found listing with ID: TS09948
2026-03-28 07:32:50 [auto1.de] INFO: Found listing with ID: RV14336
2026-03-28 07:32:50 [auto1.de] INFO: Found listing with ID: XK33490
2026-03-28 07:32:50 [auto1.de] INFO: Found listing with ID: CY08035
2026-03-28 07:32:50 [auto1.de] INFO: Found listing with ID: MP29574
2026-03-28 07:32:50 [auto1.de] INFO: Found listing with ID: KB34579
2026-03-28 07:32:50 [auto1.de] INFO: Found listing with ID: BG86685
2026-03-28 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG86685%27 HTTP/1.1" 200 None
2026-03-28 07:32:50 [auto1.de] INFO: Scrape type for BG86685: 0
2026-03-28 07:32:50 [auto1.de] INFO: Found listing with ID: PV96474
2026-03-28 07:32:50 [auto1.de] INFO: Found listing with ID: PS89246
2026-03-28 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS89246%27 HTTP/1.1" 200 None
2026-03-28 07:32:50 [auto1.de] INFO: Scrape type for PS89246: 0
2026-03-28 07:32:50 [auto1.de] INFO: Found listing with ID: XD38705
2026-03-28 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD38705%27 HTTP/1.1" 200 None
2026-03-28 07:32:50 [auto1.de] INFO: Scrape type for XD38705: 0
2026-03-28 07:32:50 [auto1.de] INFO: Found listing with ID: FK56908
2026-03-28 07:32:50 [auto1.de] INFO: Found listing with ID: WN48846
2026-03-28 07:32:50 [auto1.de] INFO: Found listing with ID: KC05152
2026-03-28 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC05152%27 HTTP/1.1" 200 None
2026-03-28 07:32:50 [auto1.de] INFO: Scrape type for KC05152: 0
2026-03-28 07:32:50 [auto1.de] INFO: Found listing with ID: AK58988
2026-03-28 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK58988%27 HTTP/1.1" 200 None
2026-03-28 07:32:50 [auto1.de] INFO: Scrape type for AK58988: 0
2026-03-28 07:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:33:01 [auto1.de] INFO: Channel: 24h | Page: 30 | totalHits: 9250 | hits on page: 40
2026-03-28 07:33:01 [auto1.de] INFO: Found listing with ID: GH45156
2026-03-28 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH45156%27 HTTP/1.1" 200 None
2026-03-28 07:33:01 [auto1.de] INFO: Scrape type for GH45156: 0
2026-03-28 07:33:01 [auto1.de] INFO: Found listing with ID: VS89065
2026-03-28 07:33:01 [auto1.de] INFO: Found listing with ID: YG83893
2026-03-28 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG83893%27 HTTP/1.1" 200 None
2026-03-28 07:33:01 [auto1.de] INFO: Scrape type for YG83893: 0
2026-03-28 07:33:01 [auto1.de] INFO: Found listing with ID: WG89224
2026-03-28 07:33:01 [auto1.de] INFO: Found listing with ID: WJ18132
2026-03-28 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ18132%27 HTTP/1.1" 200 None
2026-03-28 07:33:01 [auto1.de] INFO: Scrape type for WJ18132: 0
2026-03-28 07:33:01 [auto1.de] INFO: Found listing with ID: VJ14955
2026-03-28 07:33:01 [auto1.de] INFO: Found listing with ID: ST45837
2026-03-28 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST45837%27 HTTP/1.1" 200 None
2026-03-28 07:33:01 [auto1.de] INFO: Scrape type for ST45837: 0
2026-03-28 07:33:01 [auto1.de] INFO: Found listing with ID: YU65678
2026-03-28 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU65678%27 HTTP/1.1" 200 None
2026-03-28 07:33:01 [auto1.de] INFO: Scrape type for YU65678: 2
2026-03-28 07:33:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfa3ae42-8877-585b-b0a4-520caa88a198 with identifier: YU65678
2026-03-28 07:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfa3ae42-8877-585b-b0a4-520caa88a198 with scrape type 2
2026-03-28 07:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfa3ae42-8877-585b-b0a4-520caa88a198 with scrape type 2
2026-03-28 07:33:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cfa3ae42-8877-585b-b0a4-520caa88a198, identifier: YU65678
2026-03-28 07:33:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cfa3ae42-8877-585b-b0a4-520caa88a198 with identifier: YU65678
2026-03-28 07:33:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cfa3ae42-8877-585b-b0a4-520caa88a198 with identifier: YU65678
2026-03-28 07:33:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cfa3ae42-8877-585b-b0a4-520caa88a198 with identifier: YU65678 to the API
2026-03-28 07:33:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 55,
'expiration_date': '2026-03-28T16:12:47Z',
'fuel_type': 'petrol',
'id': 'cfa3ae42-8877-585b-b0a4-520caa88a198',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU65678',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 147652,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-08-01',
'seller_name': None,
'title': 'Skoda Fabia 1.2 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2005}
2026-03-28 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU65678%27 HTTP/1.1" 200 None
2026-03-28 07:33:02 [auto1.de] INFO: Saving data for YU65678: {'auction_closing_time': 1774714367.0, 'created_time': 1774466175.992838, 'last_price_update_time': 1774683182.888529}
2026-03-28 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU65678') HTTP/1.1" 204 0
2026-03-28 07:33:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:33:02 [auto1.de] INFO: Found listing with ID: GZ29273
2026-03-28 07:33:03 [auto1.de] INFO: Found listing with ID: JN35186
2026-03-28 07:33:03 [auto1.de] INFO: Found listing with ID: WG93037
2026-03-28 07:33:03 [auto1.de] INFO: Found listing with ID: ZP00129
2026-03-28 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP00129%27 HTTP/1.1" 200 None
2026-03-28 07:33:03 [auto1.de] INFO: Scrape type for ZP00129: 0
2026-03-28 07:33:03 [auto1.de] INFO: Found listing with ID: PZ57242
2026-03-28 07:33:03 [auto1.de] INFO: Found listing with ID: WP89589
2026-03-28 07:33:03 [auto1.de] INFO: Found listing with ID: UW74525
2026-03-28 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW74525%27 HTTP/1.1" 200 None
2026-03-28 07:33:03 [auto1.de] INFO: Scrape type for UW74525: 0
2026-03-28 07:33:03 [auto1.de] INFO: Found listing with ID: BW90089
2026-03-28 07:33:03 [auto1.de] INFO: Found listing with ID: UH95210
2026-03-28 07:33:03 [auto1.de] INFO: Found listing with ID: CD78722
2026-03-28 07:33:03 [auto1.de] INFO: Found listing with ID: AD42447
2026-03-28 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD42447%27 HTTP/1.1" 200 None
2026-03-28 07:33:03 [auto1.de] INFO: Scrape type for AD42447: 0
2026-03-28 07:33:03 [auto1.de] INFO: Found listing with ID: SA32858
2026-03-28 07:33:03 [auto1.de] INFO: Found listing with ID: CW19006
2026-03-28 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW19006%27 HTTP/1.1" 200 None
2026-03-28 07:33:03 [auto1.de] INFO: Scrape type for CW19006: 0
2026-03-28 07:33:03 [auto1.de] INFO: Found listing with ID: CP28896
2026-03-28 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP28896%27 HTTP/1.1" 200 None
2026-03-28 07:33:03 [auto1.de] INFO: Scrape type for CP28896: 2
2026-03-28 07:33:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6652cb6-b324-5873-af8d-3d8ab3642cf8 with identifier: CP28896
2026-03-28 07:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6652cb6-b324-5873-af8d-3d8ab3642cf8 with scrape type 2
2026-03-28 07:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6652cb6-b324-5873-af8d-3d8ab3642cf8 with scrape type 2
2026-03-28 07:33:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6652cb6-b324-5873-af8d-3d8ab3642cf8, identifier: CP28896
2026-03-28 07:33:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6652cb6-b324-5873-af8d-3d8ab3642cf8 with identifier: CP28896
2026-03-28 07:33:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6652cb6-b324-5873-af8d-3d8ab3642cf8 with identifier: CP28896
2026-03-28 07:33:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6652cb6-b324-5873-af8d-3d8ab3642cf8 with identifier: CP28896 to the API
2026-03-28 07:33:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:09:27Z',
'fuel_type': 'petrol',
'id': 'a6652cb6-b324-5873-af8d-3d8ab3642cf8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP28896',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 194565,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-11-20',
'seller_name': None,
'title': 'Toyota RAV 4 2.0 Special 4x4',
'transmission': 'manual',
'trim': 'Special 4x4',
'year': 2003}
2026-03-28 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP28896%27 HTTP/1.1" 200 None
2026-03-28 07:33:04 [auto1.de] INFO: Saving data for CP28896: {'auction_closing_time': 1774714167.0, 'created_time': 1774466428.383081, 'last_price_update_time': 1774683184.427094}
2026-03-28 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP28896') HTTP/1.1" 204 0
2026-03-28 07:33:04 [auto1.de] INFO: Found listing with ID: CS85382
2026-03-28 07:33:04 [auto1.de] INFO: Found listing with ID: NP57126
2026-03-28 07:33:04 [auto1.de] INFO: Found listing with ID: PY66131
2026-03-28 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY66131%27 HTTP/1.1" 200 None
2026-03-28 07:33:04 [auto1.de] INFO: Scrape type for PY66131: 0
2026-03-28 07:33:04 [auto1.de] INFO: Found listing with ID: CF83908
2026-03-28 07:33:04 [auto1.de] INFO: Found listing with ID: LW90225
2026-03-28 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW90225%27 HTTP/1.1" 200 None
2026-03-28 07:33:04 [auto1.de] INFO: Scrape type for LW90225: 0
2026-03-28 07:33:04 [auto1.de] INFO: Found listing with ID: LS49752
2026-03-28 07:33:04 [auto1.de] INFO: Found listing with ID: GW15546
2026-03-28 07:33:04 [auto1.de] INFO: Found listing with ID: XN63500
2026-03-28 07:33:04 [auto1.de] INFO: Found listing with ID: WD62968
2026-03-28 07:33:04 [auto1.de] INFO: Found listing with ID: SA60451
2026-03-28 07:33:04 [auto1.de] INFO: Found listing with ID: MY90175
2026-03-28 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY90175%27 HTTP/1.1" 200 None
2026-03-28 07:33:04 [auto1.de] INFO: Scrape type for MY90175: 0
2026-03-28 07:33:04 [auto1.de] INFO: Found listing with ID: RW76455
2026-03-28 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW76455%27 HTTP/1.1" 200 None
2026-03-28 07:33:04 [auto1.de] INFO: Scrape type for RW76455: 0
2026-03-28 07:33:04 [auto1.de] INFO: Found listing with ID: BT97147
2026-03-28 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT97147%27 HTTP/1.1" 200 None
2026-03-28 07:33:04 [auto1.de] INFO: Scrape type for BT97147: 0
2026-03-28 07:33:04 [auto1.de] INFO: Found listing with ID: EW58649
2026-03-28 07:33:04 [auto1.de] INFO: Found listing with ID: MS64258
2026-03-28 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS64258%27 HTTP/1.1" 200 None
2026-03-28 07:33:04 [auto1.de] INFO: Scrape type for MS64258: 0
2026-03-28 07:33:04 [auto1.de] INFO: Found listing with ID: SV69696
2026-03-28 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69696%27 HTTP/1.1" 200 None
2026-03-28 07:33:04 [auto1.de] INFO: Scrape type for SV69696: 0
2026-03-28 07:33:04 [auto1.de] INFO: Found listing with ID: GZ76371
2026-03-28 07:33:04 [auto1.de] INFO: Found listing with ID: TP46996
2026-03-28 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP46996%27 HTTP/1.1" 200 None
2026-03-28 07:33:04 [auto1.de] INFO: Scrape type for TP46996: 0
2026-03-28 07:33:06 [scrapy.extensions.logstats] INFO: Crawled 36 pages (at 12 pages/min), scraped 119 items (at 50 items/min)
2026-03-28 07:33:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 165MiB
2026-03-28 07:33:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:33:09 [auto1.de] INFO: Channel: 24h | Page: 31 | totalHits: 9250 | hits on page: 40
2026-03-28 07:33:09 [auto1.de] INFO: Found listing with ID: YS99143
2026-03-28 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS99143%27 HTTP/1.1" 200 None
2026-03-28 07:33:09 [auto1.de] INFO: Scrape type for YS99143: 0
2026-03-28 07:33:09 [auto1.de] INFO: Found listing with ID: AK23764
2026-03-28 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK23764%27 HTTP/1.1" 200 None
2026-03-28 07:33:09 [auto1.de] INFO: Scrape type for AK23764: 0
2026-03-28 07:33:09 [auto1.de] INFO: Found listing with ID: NM87427
2026-03-28 07:33:09 [auto1.de] INFO: Found listing with ID: ST39834
2026-03-28 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST39834%27 HTTP/1.1" 200 None
2026-03-28 07:33:09 [auto1.de] INFO: Scrape type for ST39834: 2
2026-03-28 07:33:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28be403d-3d6c-52ef-a50e-380213094955 with identifier: ST39834
2026-03-28 07:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28be403d-3d6c-52ef-a50e-380213094955 with scrape type 2
2026-03-28 07:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28be403d-3d6c-52ef-a50e-380213094955 with scrape type 2
2026-03-28 07:33:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28be403d-3d6c-52ef-a50e-380213094955, identifier: ST39834
2026-03-28 07:33:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28be403d-3d6c-52ef-a50e-380213094955 with identifier: ST39834
2026-03-28 07:33:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28be403d-3d6c-52ef-a50e-380213094955 with identifier: ST39834
2026-03-28 07:33:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28be403d-3d6c-52ef-a50e-380213094955 with identifier: ST39834 to the API
2026-03-28 07:33:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:55:11Z',
'fuel_type': 'diesel',
'id': '28be403d-3d6c-52ef-a50e-380213094955',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST39834',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 171699,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-28',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2012}
2026-03-28 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST39834%27 HTTP/1.1" 200 None
2026-03-28 07:33:09 [auto1.de] INFO: Saving data for ST39834: {'auction_closing_time': 1774716911.0, 'created_time': 1774466814.905591, 'last_price_update_time': 1774683189.730345}
2026-03-28 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST39834') HTTP/1.1" 204 0
2026-03-28 07:33:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:33:09 [auto1.de] INFO: Found listing with ID: AD30182
2026-03-28 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD30182%27 HTTP/1.1" 200 None
2026-03-28 07:33:09 [auto1.de] INFO: Scrape type for AD30182: 0
2026-03-28 07:33:09 [auto1.de] INFO: Found listing with ID: RF93551
2026-03-28 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF93551%27 HTTP/1.1" 200 None
2026-03-28 07:33:09 [auto1.de] INFO: Scrape type for RF93551: 2
2026-03-28 07:33:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a9ac933-59a6-598d-90db-28aba74a06c0 with identifier: RF93551
2026-03-28 07:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a9ac933-59a6-598d-90db-28aba74a06c0 with scrape type 2
2026-03-28 07:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a9ac933-59a6-598d-90db-28aba74a06c0 with scrape type 2
2026-03-28 07:33:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a9ac933-59a6-598d-90db-28aba74a06c0, identifier: RF93551
2026-03-28 07:33:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a9ac933-59a6-598d-90db-28aba74a06c0 with identifier: RF93551
2026-03-28 07:33:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a9ac933-59a6-598d-90db-28aba74a06c0 with identifier: RF93551
2026-03-28 07:33:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a9ac933-59a6-598d-90db-28aba74a06c0 with identifier: RF93551 to the API
2026-03-28 07:33:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:55:47Z',
'fuel_type': 'petrol',
'id': '2a9ac933-59a6-598d-90db-28aba74a06c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF93551',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Eclipse Cross',
'odometer': 49408,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-29',
'seller_name': None,
'title': 'Mitsubishi Eclipse Cross 1.5 T-MIVEC Active+ 4WD',
'transmission': 'automatic',
'trim': 'Active+ 4WD',
'year': 2020}
2026-03-28 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF93551%27 HTTP/1.1" 200 None
2026-03-28 07:33:10 [auto1.de] INFO: Saving data for RF93551: {'auction_closing_time': 1774716947.0, 'created_time': 1774466216.95893, 'last_price_update_time': 1774683190.464567}
2026-03-28 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF93551') HTTP/1.1" 204 0
2026-03-28 07:33:10 [auto1.de] INFO: Found listing with ID: NW39371
2026-03-28 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW39371%27 HTTP/1.1" 200 None
2026-03-28 07:33:10 [auto1.de] INFO: Scrape type for NW39371: 0
2026-03-28 07:33:10 [auto1.de] INFO: Found listing with ID: XV50693
2026-03-28 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV50693%27 HTTP/1.1" 200 None
2026-03-28 07:33:10 [auto1.de] INFO: Scrape type for XV50693: 0
2026-03-28 07:33:10 [auto1.de] INFO: Found listing with ID: DM54367
2026-03-28 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM54367%27 HTTP/1.1" 200 None
2026-03-28 07:33:10 [auto1.de] INFO: Scrape type for DM54367: 0
2026-03-28 07:33:10 [auto1.de] INFO: Found listing with ID: WU48136
2026-03-28 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU48136%27 HTTP/1.1" 200 None
2026-03-28 07:33:10 [auto1.de] INFO: Scrape type for WU48136: 0
2026-03-28 07:33:10 [auto1.de] INFO: Found listing with ID: PX20258
2026-03-28 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX20258%27 HTTP/1.1" 200 None
2026-03-28 07:33:10 [auto1.de] INFO: Scrape type for PX20258: 0
2026-03-28 07:33:10 [auto1.de] INFO: Found listing with ID: UP80660
2026-03-28 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP80660%27 HTTP/1.1" 200 None
2026-03-28 07:33:10 [auto1.de] INFO: Scrape type for UP80660: 0
2026-03-28 07:33:10 [auto1.de] INFO: Found listing with ID: RX04560
2026-03-28 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX04560%27 HTTP/1.1" 200 None
2026-03-28 07:33:10 [auto1.de] INFO: Scrape type for RX04560: 0
2026-03-28 07:33:10 [auto1.de] INFO: Found listing with ID: FH60355
2026-03-28 07:33:10 [auto1.de] INFO: Found listing with ID: RT79554
2026-03-28 07:33:10 [auto1.de] INFO: Found listing with ID: RT19739
2026-03-28 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT19739%27 HTTP/1.1" 200 None
2026-03-28 07:33:10 [auto1.de] INFO: Scrape type for RT19739: 2
2026-03-28 07:33:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a23c660-f99d-52d3-8630-1d5913c0998a with identifier: RT19739
2026-03-28 07:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a23c660-f99d-52d3-8630-1d5913c0998a with scrape type 2
2026-03-28 07:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a23c660-f99d-52d3-8630-1d5913c0998a with scrape type 2
2026-03-28 07:33:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a23c660-f99d-52d3-8630-1d5913c0998a, identifier: RT19739
2026-03-28 07:33:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a23c660-f99d-52d3-8630-1d5913c0998a with identifier: RT19739
2026-03-28 07:33:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a23c660-f99d-52d3-8630-1d5913c0998a with identifier: RT19739
2026-03-28 07:33:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a23c660-f99d-52d3-8630-1d5913c0998a with identifier: RT19739 to the API
2026-03-28 07:33:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:26:40Z',
'fuel_type': 'petrol',
'id': '3a23c660-f99d-52d3-8630-1d5913c0998a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT19739',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 91652,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-16',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Lounge BlueMotion Tech.',
'transmission': 'manual',
'trim': 'Lounge BlueMotion Tech.',
'year': 2015}
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT19739%27 HTTP/1.1" 200 None
2026-03-28 07:33:11 [auto1.de] INFO: Saving data for RT19739: {'auction_closing_time': 1774715200.0, 'created_time': 1774032664.048882, 'last_price_update_time': 1774683191.071679}
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT19739') HTTP/1.1" 204 0
2026-03-28 07:33:11 [auto1.de] INFO: Found listing with ID: ER72643
2026-03-28 07:33:11 [auto1.de] INFO: Found listing with ID: PW82194
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW82194%27 HTTP/1.1" 200 None
2026-03-28 07:33:11 [auto1.de] INFO: Scrape type for PW82194: 0
2026-03-28 07:33:11 [auto1.de] INFO: Found listing with ID: CH35600
2026-03-28 07:33:11 [auto1.de] INFO: Found listing with ID: ZJ19484
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ19484%27 HTTP/1.1" 200 None
2026-03-28 07:33:11 [auto1.de] INFO: Scrape type for ZJ19484: 0
2026-03-28 07:33:11 [auto1.de] INFO: Found listing with ID: JP66680
2026-03-28 07:33:11 [auto1.de] INFO: Found listing with ID: YF63409
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF63409%27 HTTP/1.1" 200 None
2026-03-28 07:33:11 [auto1.de] INFO: Scrape type for YF63409: 0
2026-03-28 07:33:11 [auto1.de] INFO: Found listing with ID: FZ49091
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ49091%27 HTTP/1.1" 200 None
2026-03-28 07:33:11 [auto1.de] INFO: Scrape type for FZ49091: 0
2026-03-28 07:33:11 [auto1.de] INFO: Found listing with ID: XS93446
2026-03-28 07:33:11 [auto1.de] INFO: Found listing with ID: PV67596
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV67596%27 HTTP/1.1" 200 None
2026-03-28 07:33:11 [auto1.de] INFO: Scrape type for PV67596: 0
2026-03-28 07:33:11 [auto1.de] INFO: Found listing with ID: TR76591
2026-03-28 07:33:11 [auto1.de] INFO: Found listing with ID: DS47068
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS47068%27 HTTP/1.1" 200 None
2026-03-28 07:33:11 [auto1.de] INFO: Scrape type for DS47068: 0
2026-03-28 07:33:11 [auto1.de] INFO: Found listing with ID: EK02801
2026-03-28 07:33:11 [auto1.de] INFO: Found listing with ID: MD20057
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD20057%27 HTTP/1.1" 200 None
2026-03-28 07:33:11 [auto1.de] INFO: Scrape type for MD20057: 0
2026-03-28 07:33:11 [auto1.de] INFO: Found listing with ID: DH11465
2026-03-28 07:33:11 [auto1.de] INFO: Found listing with ID: CA94630
2026-03-28 07:33:11 [auto1.de] INFO: Found listing with ID: RL76868
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL76868%27 HTTP/1.1" 200 None
2026-03-28 07:33:11 [auto1.de] INFO: Scrape type for RL76868: 2
2026-03-28 07:33:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bc0b907-c291-5743-80d6-8e4c863027e1 with identifier: RL76868
2026-03-28 07:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bc0b907-c291-5743-80d6-8e4c863027e1 with scrape type 2
2026-03-28 07:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bc0b907-c291-5743-80d6-8e4c863027e1 with scrape type 2
2026-03-28 07:33:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5bc0b907-c291-5743-80d6-8e4c863027e1, identifier: RL76868
2026-03-28 07:33:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5bc0b907-c291-5743-80d6-8e4c863027e1 with identifier: RL76868
2026-03-28 07:33:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5bc0b907-c291-5743-80d6-8e4c863027e1 with identifier: RL76868
2026-03-28 07:33:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5bc0b907-c291-5743-80d6-8e4c863027e1 with identifier: RL76868 to the API
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:37:31Z',
'fuel_type': 'petrol',
'id': '5bc0b907-c291-5743-80d6-8e4c863027e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL76868',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 131070,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-08',
'seller_name': None,
'title': 'Seat Ibiza 1.6 Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2009}
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL76868%27 HTTP/1.1" 200 None
2026-03-28 07:33:11 [auto1.de] INFO: Saving data for RL76868: {'auction_closing_time': 1774715851.0, 'created_time': 1774466663.329077, 'last_price_update_time': 1774683191.798092}
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL76868') HTTP/1.1" 204 0
2026-03-28 07:33:11 [auto1.de] INFO: Found listing with ID: VU50436
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU50436%27 HTTP/1.1" 200 None
2026-03-28 07:33:11 [auto1.de] INFO: Scrape type for VU50436: 0
2026-03-28 07:33:11 [auto1.de] INFO: Found listing with ID: PY88123
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88123%27 HTTP/1.1" 200 None
2026-03-28 07:33:11 [auto1.de] INFO: Scrape type for PY88123: 0
2026-03-28 07:33:11 [auto1.de] INFO: Found listing with ID: ED51510
2026-03-28 07:33:11 [auto1.de] INFO: Found listing with ID: UL19330
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL19330%27 HTTP/1.1" 200 None
2026-03-28 07:33:11 [auto1.de] INFO: Scrape type for UL19330: 0
2026-03-28 07:33:11 [auto1.de] INFO: Found listing with ID: MA62044
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA62044%27 HTTP/1.1" 200 None
2026-03-28 07:33:11 [auto1.de] INFO: Scrape type for MA62044: 0
2026-03-28 07:33:11 [auto1.de] INFO: Found listing with ID: SU53309
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU53309%27 HTTP/1.1" 200 None
2026-03-28 07:33:11 [auto1.de] INFO: Scrape type for SU53309: 0
2026-03-28 07:33:11 [auto1.de] INFO: Found listing with ID: XE97830
2026-03-28 07:33:11 [auto1.de] INFO: Found listing with ID: CS95663
2026-03-28 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS95663%27 HTTP/1.1" 200 None
2026-03-28 07:33:12 [auto1.de] INFO: Scrape type for CS95663: 0
2026-03-28 07:33:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:33:12 [auto1.de] INFO: Channel: 24h | Page: 32 | totalHits: 9250 | hits on page: 40
2026-03-28 07:33:12 [auto1.de] INFO: Found listing with ID: AJ19988
2026-03-28 07:33:12 [auto1.de] INFO: Found listing with ID: UN86111
2026-03-28 07:33:12 [auto1.de] INFO: Found listing with ID: LT67236
2026-03-28 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT67236%27 HTTP/1.1" 200 None
2026-03-28 07:33:12 [auto1.de] INFO: Scrape type for LT67236: 2
2026-03-28 07:33:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f48a980-4f21-56a2-82d0-318c1229531f with identifier: LT67236
2026-03-28 07:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f48a980-4f21-56a2-82d0-318c1229531f with scrape type 2
2026-03-28 07:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f48a980-4f21-56a2-82d0-318c1229531f with scrape type 2
2026-03-28 07:33:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f48a980-4f21-56a2-82d0-318c1229531f, identifier: LT67236
2026-03-28 07:33:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f48a980-4f21-56a2-82d0-318c1229531f with identifier: LT67236
2026-03-28 07:33:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f48a980-4f21-56a2-82d0-318c1229531f with identifier: LT67236
2026-03-28 07:33:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f48a980-4f21-56a2-82d0-318c1229531f with identifier: LT67236 to the API
2026-03-28 07:33:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:28:41Z',
'fuel_type': 'diesel',
'id': '6f48a980-4f21-56a2-82d0-318c1229531f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT67236',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 183266,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-09',
'seller_name': None,
'title': 'BMW X1 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT67236%27 HTTP/1.1" 200 None
2026-03-28 07:33:13 [auto1.de] INFO: Saving data for LT67236: {'auction_closing_time': 1774715321.0, 'created_time': 1774464580.077529, 'last_price_update_time': 1774683193.133894}
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT67236') HTTP/1.1" 204 0
2026-03-28 07:33:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: HW22525
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW22525%27 HTTP/1.1" 200 None
2026-03-28 07:33:13 [auto1.de] INFO: Scrape type for HW22525: 0
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: PP02879
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: HE75386
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: VZ19342
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ19342%27 HTTP/1.1" 200 None
2026-03-28 07:33:13 [auto1.de] INFO: Scrape type for VZ19342: 0
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: MK06365
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: DK10933
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK10933%27 HTTP/1.1" 200 None
2026-03-28 07:33:13 [auto1.de] INFO: Scrape type for DK10933: 0
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: TR13972
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: NZ51315
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ51315%27 HTTP/1.1" 200 None
2026-03-28 07:33:13 [auto1.de] INFO: Scrape type for NZ51315: 0
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: HV42647
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: PA83352
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA83352%27 HTTP/1.1" 200 None
2026-03-28 07:33:13 [auto1.de] INFO: Scrape type for PA83352: 0
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: GM59339
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59339%27 HTTP/1.1" 200 None
2026-03-28 07:33:13 [auto1.de] INFO: Scrape type for GM59339: 0
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: WR71017
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: EZ35619
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: JG22521
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: TX59054
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX59054%27 HTTP/1.1" 200 None
2026-03-28 07:33:13 [auto1.de] INFO: Scrape type for TX59054: 0
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: CS66629
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: TH58497
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: XV43778
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: PX36804
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX36804%27 HTTP/1.1" 200 None
2026-03-28 07:33:13 [auto1.de] INFO: Scrape type for PX36804: 0
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: ZK07522
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK07522%27 HTTP/1.1" 200 None
2026-03-28 07:33:13 [auto1.de] INFO: Scrape type for ZK07522: 0
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: PW66424
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW66424%27 HTTP/1.1" 200 None
2026-03-28 07:33:13 [auto1.de] INFO: Scrape type for PW66424: 0
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: FX01006
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: VF30543
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF30543%27 HTTP/1.1" 200 None
2026-03-28 07:33:13 [auto1.de] INFO: Scrape type for VF30543: 0
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: LE20823
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: MF41784
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41784%27 HTTP/1.1" 200 None
2026-03-28 07:33:13 [auto1.de] INFO: Scrape type for MF41784: 0
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: XU52502
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: NC43616
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: WA42384
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: YR31209
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR31209%27 HTTP/1.1" 200 None
2026-03-28 07:33:13 [auto1.de] INFO: Scrape type for YR31209: 0
2026-03-28 07:33:13 [auto1.de] INFO: Found listing with ID: MM41381
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM41381%27 HTTP/1.1" 200 None
2026-03-28 07:33:13 [auto1.de] INFO: Scrape type for MM41381: 2
2026-03-28 07:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae6e45e2-8300-5130-8272-52e376783399 with identifier: MM41381
2026-03-28 07:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae6e45e2-8300-5130-8272-52e376783399 with scrape type 2
2026-03-28 07:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae6e45e2-8300-5130-8272-52e376783399 with scrape type 2
2026-03-28 07:33:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae6e45e2-8300-5130-8272-52e376783399, identifier: MM41381
2026-03-28 07:33:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae6e45e2-8300-5130-8272-52e376783399 with identifier: MM41381
2026-03-28 07:33:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae6e45e2-8300-5130-8272-52e376783399 with identifier: MM41381
2026-03-28 07:33:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae6e45e2-8300-5130-8272-52e376783399 with identifier: MM41381 to the API
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-28T16:09:02Z',
'fuel_type': 'petrol',
'id': 'ae6e45e2-8300-5130-8272-52e376783399',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM41381',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 132860,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-08',
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2017}
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM41381%27 HTTP/1.1" 200 None
2026-03-28 07:33:13 [auto1.de] INFO: Saving data for MM41381: {'auction_closing_time': 1774714142.0, 'created_time': 1774467871.141502, 'last_price_update_time': 1774683193.905687}
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM41381') HTTP/1.1" 204 0
2026-03-28 07:33:14 [auto1.de] INFO: Found listing with ID: DW77915
2026-03-28 07:33:14 [auto1.de] INFO: Found listing with ID: JD69912
2026-03-28 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD69912%27 HTTP/1.1" 200 None
2026-03-28 07:33:14 [auto1.de] INFO: Scrape type for JD69912: 0
2026-03-28 07:33:14 [auto1.de] INFO: Found listing with ID: LB51000
2026-03-28 07:33:14 [auto1.de] INFO: Found listing with ID: DH10709
2026-03-28 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH10709%27 HTTP/1.1" 200 None
2026-03-28 07:33:14 [auto1.de] INFO: Scrape type for DH10709: 2
2026-03-28 07:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e59153f6-f49d-5189-8995-e69206dfcccb with identifier: DH10709
2026-03-28 07:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e59153f6-f49d-5189-8995-e69206dfcccb with scrape type 2
2026-03-28 07:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e59153f6-f49d-5189-8995-e69206dfcccb with scrape type 2
2026-03-28 07:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e59153f6-f49d-5189-8995-e69206dfcccb, identifier: DH10709
2026-03-28 07:33:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e59153f6-f49d-5189-8995-e69206dfcccb with identifier: DH10709
2026-03-28 07:33:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e59153f6-f49d-5189-8995-e69206dfcccb with identifier: DH10709
2026-03-28 07:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e59153f6-f49d-5189-8995-e69206dfcccb with identifier: DH10709 to the API
2026-03-28 07:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-28T16:14:34Z',
'fuel_type': 'petrol',
'id': 'e59153f6-f49d-5189-8995-e69206dfcccb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH10709',
'listing': 'auction',
'make': 'Ford',
'model': 'Galaxy',
'odometer': 144910,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-16',
'seller_name': None,
'title': 'Ford Galaxy 2.0 EcoBoost Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2016}
2026-03-28 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH10709%27 HTTP/1.1" 200 None
2026-03-28 07:33:14 [auto1.de] INFO: Saving data for DH10709: {'auction_closing_time': 1774714474.0, 'created_time': 1774467047.17104, 'last_price_update_time': 1774683194.469647}
2026-03-28 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DH10709') HTTP/1.1" 204 0
2026-03-28 07:33:14 [auto1.de] INFO: Found listing with ID: PR50786
2026-03-28 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR50786%27 HTTP/1.1" 200 None
2026-03-28 07:33:14 [auto1.de] INFO: Scrape type for PR50786: 0
2026-03-28 07:33:14 [auto1.de] INFO: Found listing with ID: AM35234
2026-03-28 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM35234%27 HTTP/1.1" 200 None
2026-03-28 07:33:14 [auto1.de] INFO: Scrape type for AM35234: 0
2026-03-28 07:33:14 [auto1.de] INFO: Found listing with ID: KF96616
2026-03-28 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96616%27 HTTP/1.1" 200 None
2026-03-28 07:33:14 [auto1.de] INFO: Scrape type for KF96616: 0
2026-03-28 07:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:33:23 [auto1.de] INFO: Channel: 24h | Page: 33 | totalHits: 9251 | hits on page: 40
2026-03-28 07:33:23 [auto1.de] INFO: Found listing with ID: KF96616
2026-03-28 07:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96616%27 HTTP/1.1" 200 None
2026-03-28 07:33:23 [auto1.de] INFO: Scrape type for KF96616: 0
2026-03-28 07:33:23 [auto1.de] INFO: Found listing with ID: MS83797
2026-03-28 07:33:23 [auto1.de] INFO: Found listing with ID: EZ29207
2026-03-28 07:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ29207%27 HTTP/1.1" 200 None
2026-03-28 07:33:23 [auto1.de] INFO: Scrape type for EZ29207: 2
2026-03-28 07:33:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fe94700-d209-56a6-b4ae-747de24ff4d9 with identifier: EZ29207
2026-03-28 07:33:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fe94700-d209-56a6-b4ae-747de24ff4d9 with scrape type 2
2026-03-28 07:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fe94700-d209-56a6-b4ae-747de24ff4d9 with scrape type 2
2026-03-28 07:33:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fe94700-d209-56a6-b4ae-747de24ff4d9, identifier: EZ29207
2026-03-28 07:33:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fe94700-d209-56a6-b4ae-747de24ff4d9 with identifier: EZ29207
2026-03-28 07:33:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fe94700-d209-56a6-b4ae-747de24ff4d9 with identifier: EZ29207
2026-03-28 07:33:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fe94700-d209-56a6-b4ae-747de24ff4d9 with identifier: EZ29207 to the API
2026-03-28 07:33:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:29:59Z',
'fuel_type': 'petrol',
'id': '0fe94700-d209-56a6-b4ae-747de24ff4d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ29207',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 161406,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-22',
'seller_name': None,
'title': 'Seat Leon 1.4 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2014}
2026-03-28 07:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ29207%27 HTTP/1.1" 200 None
2026-03-28 07:33:23 [auto1.de] INFO: Saving data for EZ29207: {'auction_closing_time': 1774715399.0, 'created_time': 1774466746.922057, 'last_price_update_time': 1774683203.9606}
2026-03-28 07:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ29207') HTTP/1.1" 204 0
2026-03-28 07:33:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:33:23 [auto1.de] INFO: Found listing with ID: AJ30359
2026-03-28 07:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ30359%27 HTTP/1.1" 200 None
2026-03-28 07:33:24 [auto1.de] INFO: Scrape type for AJ30359: 2
2026-03-28 07:33:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78496df6-1aa8-5709-bce5-f3920c698310 with identifier: AJ30359
2026-03-28 07:33:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78496df6-1aa8-5709-bce5-f3920c698310 with scrape type 2
2026-03-28 07:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78496df6-1aa8-5709-bce5-f3920c698310 with scrape type 2
2026-03-28 07:33:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78496df6-1aa8-5709-bce5-f3920c698310, identifier: AJ30359
2026-03-28 07:33:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78496df6-1aa8-5709-bce5-f3920c698310 with identifier: AJ30359
2026-03-28 07:33:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78496df6-1aa8-5709-bce5-f3920c698310 with identifier: AJ30359
2026-03-28 07:33:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78496df6-1aa8-5709-bce5-f3920c698310 with identifier: AJ30359 to the API
2026-03-28 07:33:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:40:02Z',
'fuel_type': 'diesel',
'id': '78496df6-1aa8-5709-bce5-f3920c698310',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ30359',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 91472,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-17',
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 340 L2 Trend',
'transmission': 'automatic',
'trim': '340 L2 Trend',
'year': 2021}
2026-03-28 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ30359%27 HTTP/1.1" 200 None
2026-03-28 07:33:24 [auto1.de] INFO: Saving data for AJ30359: {'auction_closing_time': 1774716002.0, 'created_time': 1774466126.546535, 'last_price_update_time': 1774683204.391476}
2026-03-28 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ30359') HTTP/1.1" 204 0
2026-03-28 07:33:24 [auto1.de] INFO: Found listing with ID: TF26845
2026-03-28 07:33:24 [auto1.de] INFO: Found listing with ID: FR49421
2026-03-28 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR49421%27 HTTP/1.1" 200 None
2026-03-28 07:33:24 [auto1.de] INFO: Scrape type for FR49421: 2
2026-03-28 07:33:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9acb7a07-f0b1-5571-aae3-d42289cf84e7 with identifier: FR49421
2026-03-28 07:33:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9acb7a07-f0b1-5571-aae3-d42289cf84e7 with scrape type 2
2026-03-28 07:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9acb7a07-f0b1-5571-aae3-d42289cf84e7 with scrape type 2
2026-03-28 07:33:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9acb7a07-f0b1-5571-aae3-d42289cf84e7, identifier: FR49421
2026-03-28 07:33:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9acb7a07-f0b1-5571-aae3-d42289cf84e7 with identifier: FR49421
2026-03-28 07:33:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9acb7a07-f0b1-5571-aae3-d42289cf84e7 with identifier: FR49421
2026-03-28 07:33:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9acb7a07-f0b1-5571-aae3-d42289cf84e7 with identifier: FR49421 to the API
2026-03-28 07:33:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:53:47Z',
'fuel_type': 'diesel',
'id': '9acb7a07-f0b1-5571-aae3-d42289cf84e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR49421',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 433041,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-31',
'seller_name': None,
'title': 'Seat Ibiza 1.6 TDI Stylance / Style',
'transmission': 'manual',
'trim': 'Stylance / Style',
'year': 2009}
2026-03-28 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR49421%27 HTTP/1.1" 200 None
2026-03-28 07:33:24 [auto1.de] INFO: Saving data for FR49421: {'auction_closing_time': 1774716827.0, 'created_time': 1774466341.95842, 'last_price_update_time': 1774683204.917311}
2026-03-28 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR49421') HTTP/1.1" 204 0
2026-03-28 07:33:24 [auto1.de] INFO: Found listing with ID: XE20875
2026-03-28 07:33:24 [auto1.de] INFO: Found listing with ID: HE95422
2026-03-28 07:33:24 [auto1.de] INFO: Found listing with ID: FL47412
2026-03-28 07:33:24 [auto1.de] INFO: Found listing with ID: KV09171
2026-03-28 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV09171%27 HTTP/1.1" 200 None
2026-03-28 07:33:24 [auto1.de] INFO: Scrape type for KV09171: 0
2026-03-28 07:33:24 [auto1.de] INFO: Found listing with ID: VE03726
2026-03-28 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE03726%27 HTTP/1.1" 200 None
2026-03-28 07:33:24 [auto1.de] INFO: Scrape type for VE03726: 0
2026-03-28 07:33:24 [auto1.de] INFO: Found listing with ID: EC82787
2026-03-28 07:33:24 [auto1.de] INFO: Found listing with ID: RD70128
2026-03-28 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD70128%27 HTTP/1.1" 200 None
2026-03-28 07:33:24 [auto1.de] INFO: Scrape type for RD70128: 0
2026-03-28 07:33:24 [auto1.de] INFO: Found listing with ID: UC09176
2026-03-28 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC09176%27 HTTP/1.1" 200 None
2026-03-28 07:33:24 [auto1.de] INFO: Scrape type for UC09176: 0
2026-03-28 07:33:24 [auto1.de] INFO: Found listing with ID: AN49564
2026-03-28 07:33:24 [auto1.de] INFO: Found listing with ID: SV38598
2026-03-28 07:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV38598%27 HTTP/1.1" 200 None
2026-03-28 07:33:25 [auto1.de] INFO: Scrape type for SV38598: 0
2026-03-28 07:33:25 [auto1.de] INFO: Found listing with ID: JM39243
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM39243%27 HTTP/1.1" 200 None
2026-03-28 07:33:25 [auto1.de] INFO: Scrape type for JM39243: 0
2026-03-28 07:33:25 [auto1.de] INFO: Found listing with ID: XJ09015
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ09015%27 HTTP/1.1" 200 None
2026-03-28 07:33:25 [auto1.de] INFO: Scrape type for XJ09015: 0
2026-03-28 07:33:25 [auto1.de] INFO: Found listing with ID: JY20186
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY20186%27 HTTP/1.1" 200 None
2026-03-28 07:33:25 [auto1.de] INFO: Scrape type for JY20186: 0
2026-03-28 07:33:25 [auto1.de] INFO: Found listing with ID: SJ64041
2026-03-28 07:33:25 [auto1.de] INFO: Found listing with ID: ZC73277
2026-03-28 07:33:25 [auto1.de] INFO: Found listing with ID: FL25481
2026-03-28 07:33:25 [auto1.de] INFO: Found listing with ID: BS60844
2026-03-28 07:33:25 [auto1.de] INFO: Found listing with ID: SR33990
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR33990%27 HTTP/1.1" 200 None
2026-03-28 07:33:25 [auto1.de] INFO: Scrape type for SR33990: 0
2026-03-28 07:33:25 [auto1.de] INFO: Found listing with ID: ZC73485
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC73485%27 HTTP/1.1" 200 None
2026-03-28 07:33:25 [auto1.de] INFO: Scrape type for ZC73485: 2
2026-03-28 07:33:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5480497f-d388-56ea-8794-382464e7ab3f with identifier: ZC73485
2026-03-28 07:33:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5480497f-d388-56ea-8794-382464e7ab3f with scrape type 2
2026-03-28 07:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5480497f-d388-56ea-8794-382464e7ab3f with scrape type 2
2026-03-28 07:33:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5480497f-d388-56ea-8794-382464e7ab3f, identifier: ZC73485
2026-03-28 07:33:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5480497f-d388-56ea-8794-382464e7ab3f with identifier: ZC73485
2026-03-28 07:33:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5480497f-d388-56ea-8794-382464e7ab3f with identifier: ZC73485
2026-03-28 07:33:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5480497f-d388-56ea-8794-382464e7ab3f with identifier: ZC73485 to the API
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:19:19Z',
'fuel_type': 'diesel',
'id': '5480497f-d388-56ea-8794-382464e7ab3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC73485',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 151932,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-23',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Drive 4x4',
'transmission': 'automatic',
'trim': 'Drive 4x4',
'year': 2017}
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC73485%27 HTTP/1.1" 200 None
2026-03-28 07:33:25 [auto1.de] INFO: Saving data for ZC73485: {'auction_closing_time': 1774714759.0, 'created_time': 1774466252.248806, 'last_price_update_time': 1774683205.510898}
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC73485') HTTP/1.1" 204 0
2026-03-28 07:33:25 [auto1.de] INFO: Found listing with ID: XC67226
2026-03-28 07:33:25 [auto1.de] INFO: Found listing with ID: PN60983
2026-03-28 07:33:25 [auto1.de] INFO: Found listing with ID: HZ37968
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ37968%27 HTTP/1.1" 200 None
2026-03-28 07:33:25 [auto1.de] INFO: Scrape type for HZ37968: 0
2026-03-28 07:33:25 [auto1.de] INFO: Found listing with ID: AB21758
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB21758%27 HTTP/1.1" 200 None
2026-03-28 07:33:25 [auto1.de] INFO: Scrape type for AB21758: 0
2026-03-28 07:33:25 [auto1.de] INFO: Found listing with ID: EX42379
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX42379%27 HTTP/1.1" 200 None
2026-03-28 07:33:25 [auto1.de] INFO: Scrape type for EX42379: 0
2026-03-28 07:33:25 [auto1.de] INFO: Found listing with ID: MN42174
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN42174%27 HTTP/1.1" 200 None
2026-03-28 07:33:25 [auto1.de] INFO: Scrape type for MN42174: 0
2026-03-28 07:33:25 [auto1.de] INFO: Found listing with ID: HS09512
2026-03-28 07:33:25 [auto1.de] INFO: Found listing with ID: VR15853
2026-03-28 07:33:25 [auto1.de] INFO: Found listing with ID: UY94864
2026-03-28 07:33:25 [auto1.de] INFO: Found listing with ID: AP00177
2026-03-28 07:33:25 [auto1.de] INFO: Found listing with ID: AV59132
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV59132%27 HTTP/1.1" 200 None
2026-03-28 07:33:25 [auto1.de] INFO: Scrape type for AV59132: 2
2026-03-28 07:33:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f8dcdc3-ad91-5e23-a8c5-68398ef83862 with identifier: AV59132
2026-03-28 07:33:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f8dcdc3-ad91-5e23-a8c5-68398ef83862 with scrape type 2
2026-03-28 07:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f8dcdc3-ad91-5e23-a8c5-68398ef83862 with scrape type 2
2026-03-28 07:33:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f8dcdc3-ad91-5e23-a8c5-68398ef83862, identifier: AV59132
2026-03-28 07:33:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f8dcdc3-ad91-5e23-a8c5-68398ef83862 with identifier: AV59132
2026-03-28 07:33:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f8dcdc3-ad91-5e23-a8c5-68398ef83862 with identifier: AV59132
2026-03-28 07:33:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f8dcdc3-ad91-5e23-a8c5-68398ef83862 with identifier: AV59132 to the API
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-28T16:56:08Z',
'fuel_type': 'diesel',
'id': '8f8dcdc3-ad91-5e23-a8c5-68398ef83862',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV59132',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 236104,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-25',
'seller_name': None,
'title': 'Audi A4 2.0 TDI quattro S line Sportpaket plus',
'transmission': 'manual',
'trim': 'quattro S line Sportpaket plus',
'year': 2010}
2026-03-28 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV59132%27 HTTP/1.1" 200 None
2026-03-28 07:33:26 [auto1.de] INFO: Saving data for AV59132: {'auction_closing_time': 1774716968.0, 'created_time': 1774467647.982776, 'last_price_update_time': 1774683206.121546}
2026-03-28 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AV59132') HTTP/1.1" 204 0
2026-03-28 07:33:26 [auto1.de] INFO: Found listing with ID: WN98613
2026-03-28 07:33:26 [auto1.de] INFO: Found listing with ID: LK47364
2026-03-28 07:33:26 [auto1.de] INFO: Found listing with ID: MS42171
2026-03-28 07:33:26 [auto1.de] INFO: Found listing with ID: GS07550
2026-03-28 07:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:33:27 [auto1.de] INFO: Channel: 24h | Page: 34 | totalHits: 9251 | hits on page: 40
2026-03-28 07:33:27 [auto1.de] INFO: Found listing with ID: WU35652
2026-03-28 07:33:27 [auto1.de] INFO: Found listing with ID: JY24308
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY24308%27 HTTP/1.1" 200 None
2026-03-28 07:33:27 [auto1.de] INFO: Scrape type for JY24308: 0
2026-03-28 07:33:27 [auto1.de] INFO: Found listing with ID: NT94381
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT94381%27 HTTP/1.1" 200 None
2026-03-28 07:33:27 [auto1.de] INFO: Scrape type for NT94381: 2
2026-03-28 07:33:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a99580d2-587f-5bf5-9e8b-c3f631874295 with identifier: NT94381
2026-03-28 07:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a99580d2-587f-5bf5-9e8b-c3f631874295 with scrape type 2
2026-03-28 07:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a99580d2-587f-5bf5-9e8b-c3f631874295 with scrape type 2
2026-03-28 07:33:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a99580d2-587f-5bf5-9e8b-c3f631874295, identifier: NT94381
2026-03-28 07:33:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a99580d2-587f-5bf5-9e8b-c3f631874295 with identifier: NT94381
2026-03-28 07:33:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a99580d2-587f-5bf5-9e8b-c3f631874295 with identifier: NT94381
2026-03-28 07:33:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a99580d2-587f-5bf5-9e8b-c3f631874295 with identifier: NT94381 to the API
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:37:08Z',
'fuel_type': 'diesel',
'id': 'a99580d2-587f-5bf5-9e8b-c3f631874295',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT94381',
'listing': 'auction',
'make': 'Citroen',
'model': 'Jumper',
'odometer': 80114,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-29',
'seller_name': None,
'title': 'Citroen Jumper 2.0 Blue-HDi 30 L2H1 Profi',
'transmission': 'manual',
'trim': '30 L2H1 Profi',
'year': 2017}
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT94381%27 HTTP/1.1" 200 None
2026-03-28 07:33:27 [auto1.de] INFO: Saving data for NT94381: {'auction_closing_time': 1774715828.0, 'created_time': 1774379416.324946, 'last_price_update_time': 1774683207.527932}
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT94381') HTTP/1.1" 204 0
2026-03-28 07:33:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:33:27 [auto1.de] INFO: Found listing with ID: UV59464
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV59464%27 HTTP/1.1" 200 None
2026-03-28 07:33:27 [auto1.de] INFO: Scrape type for UV59464: 0
2026-03-28 07:33:27 [auto1.de] INFO: Found listing with ID: XF58855
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF58855%27 HTTP/1.1" 200 None
2026-03-28 07:33:27 [auto1.de] INFO: Scrape type for XF58855: 0
2026-03-28 07:33:27 [auto1.de] INFO: Found listing with ID: CK72775
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72775%27 HTTP/1.1" 200 None
2026-03-28 07:33:27 [auto1.de] INFO: Scrape type for CK72775: 0
2026-03-28 07:33:27 [auto1.de] INFO: Found listing with ID: PH65688
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH65688%27 HTTP/1.1" 200 None
2026-03-28 07:33:27 [auto1.de] INFO: Scrape type for PH65688: 0
2026-03-28 07:33:27 [auto1.de] INFO: Found listing with ID: YN98514
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN98514%27 HTTP/1.1" 200 None
2026-03-28 07:33:27 [auto1.de] INFO: Scrape type for YN98514: 0
2026-03-28 07:33:27 [auto1.de] INFO: Found listing with ID: AM78577
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM78577%27 HTTP/1.1" 200 None
2026-03-28 07:33:27 [auto1.de] INFO: Scrape type for AM78577: 0
2026-03-28 07:33:27 [auto1.de] INFO: Found listing with ID: AZ27432
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ27432%27 HTTP/1.1" 200 None
2026-03-28 07:33:27 [auto1.de] INFO: Scrape type for AZ27432: 2
2026-03-28 07:33:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d07945f-684e-5c2b-82d2-0ab19a2c1838 with identifier: AZ27432
2026-03-28 07:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d07945f-684e-5c2b-82d2-0ab19a2c1838 with scrape type 2
2026-03-28 07:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d07945f-684e-5c2b-82d2-0ab19a2c1838 with scrape type 2
2026-03-28 07:33:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d07945f-684e-5c2b-82d2-0ab19a2c1838, identifier: AZ27432
2026-03-28 07:33:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d07945f-684e-5c2b-82d2-0ab19a2c1838 with identifier: AZ27432
2026-03-28 07:33:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d07945f-684e-5c2b-82d2-0ab19a2c1838 with identifier: AZ27432
2026-03-28 07:33:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d07945f-684e-5c2b-82d2-0ab19a2c1838 with identifier: AZ27432 to the API
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:00:30Z',
'fuel_type': 'diesel',
'id': '2d07945f-684e-5c2b-82d2-0ab19a2c1838',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ27432',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 239626,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-22',
'seller_name': None,
'title': 'Volkswagen Caddy 2.0 TDI Maxi Kasten 4Motion',
'transmission': 'manual',
'trim': 'Maxi Kasten 4Motion',
'year': 2011}
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ27432%27 HTTP/1.1" 200 None
2026-03-28 07:33:28 [auto1.de] INFO: Saving data for AZ27432: {'auction_closing_time': 1774713630.0, 'created_time': 1774465613.000742, 'last_price_update_time': 1774683208.058757}
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ27432') HTTP/1.1" 204 0
2026-03-28 07:33:28 [auto1.de] INFO: Found listing with ID: FZ54460
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ54460%27 HTTP/1.1" 200 None
2026-03-28 07:33:28 [auto1.de] INFO: Scrape type for FZ54460: 2
2026-03-28 07:33:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13ca1bbb-84b1-5139-b4f8-561bb9be915b with identifier: FZ54460
2026-03-28 07:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13ca1bbb-84b1-5139-b4f8-561bb9be915b with scrape type 2
2026-03-28 07:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13ca1bbb-84b1-5139-b4f8-561bb9be915b with scrape type 2
2026-03-28 07:33:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13ca1bbb-84b1-5139-b4f8-561bb9be915b, identifier: FZ54460
2026-03-28 07:33:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13ca1bbb-84b1-5139-b4f8-561bb9be915b with identifier: FZ54460
2026-03-28 07:33:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13ca1bbb-84b1-5139-b4f8-561bb9be915b with identifier: FZ54460
2026-03-28 07:33:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13ca1bbb-84b1-5139-b4f8-561bb9be915b with identifier: FZ54460 to the API
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 68,
'expiration_date': '2026-03-28T16:37:14Z',
'fuel_type': 'petrol',
'id': '13ca1bbb-84b1-5139-b4f8-561bb9be915b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ54460',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 119891,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-31',
'seller_name': None,
'title': 'Peugeot 208 1.0 VTi Access',
'transmission': 'manual',
'trim': 'Access',
'year': 2013}
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ54460%27 HTTP/1.1" 200 None
2026-03-28 07:33:28 [auto1.de] INFO: Saving data for FZ54460: {'auction_closing_time': 1774715834.0, 'created_time': 1774466959.331622, 'last_price_update_time': 1774683208.622142}
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ54460') HTTP/1.1" 204 0
2026-03-28 07:33:28 [auto1.de] INFO: Found listing with ID: KK55590
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK55590%27 HTTP/1.1" 200 None
2026-03-28 07:33:28 [auto1.de] INFO: Scrape type for KK55590: 0
2026-03-28 07:33:28 [auto1.de] INFO: Found listing with ID: NC47913
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC47913%27 HTTP/1.1" 200 None
2026-03-28 07:33:28 [auto1.de] INFO: Scrape type for NC47913: 0
2026-03-28 07:33:28 [auto1.de] INFO: Found listing with ID: JZ25562
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ25562%27 HTTP/1.1" 200 None
2026-03-28 07:33:28 [auto1.de] INFO: Scrape type for JZ25562: 0
2026-03-28 07:33:28 [auto1.de] INFO: Found listing with ID: KD46198
2026-03-28 07:33:28 [auto1.de] INFO: Found listing with ID: FC08101
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC08101%27 HTTP/1.1" 200 None
2026-03-28 07:33:28 [auto1.de] INFO: Scrape type for FC08101: 0
2026-03-28 07:33:28 [auto1.de] INFO: Found listing with ID: DN96798
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN96798%27 HTTP/1.1" 200 None
2026-03-28 07:33:28 [auto1.de] INFO: Scrape type for DN96798: 0
2026-03-28 07:33:28 [auto1.de] INFO: Found listing with ID: BM71069
2026-03-28 07:33:28 [auto1.de] INFO: Found listing with ID: CK18909
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK18909%27 HTTP/1.1" 200 None
2026-03-28 07:33:28 [auto1.de] INFO: Scrape type for CK18909: 0
2026-03-28 07:33:28 [auto1.de] INFO: Found listing with ID: FP35448
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP35448%27 HTTP/1.1" 200 None
2026-03-28 07:33:28 [auto1.de] INFO: Scrape type for FP35448: 0
2026-03-28 07:33:28 [auto1.de] INFO: Found listing with ID: WW83643
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW83643%27 HTTP/1.1" 200 None
2026-03-28 07:33:28 [auto1.de] INFO: Scrape type for WW83643: 2
2026-03-28 07:33:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b695020-83de-58ce-936e-01f0775f0ab5 with identifier: WW83643
2026-03-28 07:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b695020-83de-58ce-936e-01f0775f0ab5 with scrape type 2
2026-03-28 07:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b695020-83de-58ce-936e-01f0775f0ab5 with scrape type 2
2026-03-28 07:33:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b695020-83de-58ce-936e-01f0775f0ab5, identifier: WW83643
2026-03-28 07:33:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b695020-83de-58ce-936e-01f0775f0ab5 with identifier: WW83643
2026-03-28 07:33:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b695020-83de-58ce-936e-01f0775f0ab5 with identifier: WW83643
2026-03-28 07:33:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b695020-83de-58ce-936e-01f0775f0ab5 with identifier: WW83643 to the API
2026-03-28 07:33:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:30:30Z',
'fuel_type': 'petrol',
'id': '9b695020-83de-58ce-936e-01f0775f0ab5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW83643',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 94022,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-08-26',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Style',
'transmission': 'manual',
'trim': 'BlueEfficiency Style',
'year': 2013}
2026-03-28 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW83643%27 HTTP/1.1" 200 None
2026-03-28 07:33:29 [auto1.de] INFO: Saving data for WW83643: {'auction_closing_time': 1774715430.0, 'created_time': 1774466936.676615, 'last_price_update_time': 1774683209.179207}
2026-03-28 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW83643') HTTP/1.1" 204 0
2026-03-28 07:33:29 [auto1.de] INFO: Found listing with ID: FU32442
2026-03-28 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU32442%27 HTTP/1.1" 200 None
2026-03-28 07:33:29 [auto1.de] INFO: Scrape type for FU32442: 0
2026-03-28 07:33:29 [auto1.de] INFO: Found listing with ID: HP04846
2026-03-28 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP04846%27 HTTP/1.1" 200 None
2026-03-28 07:33:29 [auto1.de] INFO: Scrape type for HP04846: 2
2026-03-28 07:33:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8503edcf-4a78-5ef3-bfaf-3c2db0be4f2f with identifier: HP04846
2026-03-28 07:33:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8503edcf-4a78-5ef3-bfaf-3c2db0be4f2f with scrape type 2
2026-03-28 07:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8503edcf-4a78-5ef3-bfaf-3c2db0be4f2f with scrape type 2
2026-03-28 07:33:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8503edcf-4a78-5ef3-bfaf-3c2db0be4f2f, identifier: HP04846
2026-03-28 07:33:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8503edcf-4a78-5ef3-bfaf-3c2db0be4f2f with identifier: HP04846
2026-03-28 07:33:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8503edcf-4a78-5ef3-bfaf-3c2db0be4f2f with identifier: HP04846
2026-03-28 07:33:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8503edcf-4a78-5ef3-bfaf-3c2db0be4f2f with identifier: HP04846 to the API
2026-03-28 07:33:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:26:11Z',
'fuel_type': 'diesel',
'id': '8503edcf-4a78-5ef3-bfaf-3c2db0be4f2f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP04846',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 329334,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-17',
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TDI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2019}
2026-03-28 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP04846%27 HTTP/1.1" 200 None
2026-03-28 07:33:29 [auto1.de] INFO: Saving data for HP04846: {'auction_closing_time': 1774715171.0, 'created_time': 1774466709.607975, 'last_price_update_time': 1774683209.739446}
2026-03-28 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP04846') HTTP/1.1" 204 0
2026-03-28 07:33:29 [auto1.de] INFO: Found listing with ID: EL67777
2026-03-28 07:33:29 [auto1.de] INFO: Found listing with ID: MP71247
2026-03-28 07:33:29 [auto1.de] INFO: Found listing with ID: SA48353
2026-03-28 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA48353%27 HTTP/1.1" 200 None
2026-03-28 07:33:29 [auto1.de] INFO: Scrape type for SA48353: 0
2026-03-28 07:33:29 [auto1.de] INFO: Found listing with ID: ET75266
2026-03-28 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET75266%27 HTTP/1.1" 200 None
2026-03-28 07:33:29 [auto1.de] INFO: Scrape type for ET75266: 0
2026-03-28 07:33:29 [auto1.de] INFO: Found listing with ID: YX64853
2026-03-28 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX64853%27 HTTP/1.1" 200 None
2026-03-28 07:33:29 [auto1.de] INFO: Scrape type for YX64853: 2
2026-03-28 07:33:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e51a4c93-4d23-59f6-a7f4-57020d6fcf83 with identifier: YX64853
2026-03-28 07:33:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e51a4c93-4d23-59f6-a7f4-57020d6fcf83 with scrape type 2
2026-03-28 07:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e51a4c93-4d23-59f6-a7f4-57020d6fcf83 with scrape type 2
2026-03-28 07:33:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e51a4c93-4d23-59f6-a7f4-57020d6fcf83, identifier: YX64853
2026-03-28 07:33:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e51a4c93-4d23-59f6-a7f4-57020d6fcf83 with identifier: YX64853
2026-03-28 07:33:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e51a4c93-4d23-59f6-a7f4-57020d6fcf83 with identifier: YX64853
2026-03-28 07:33:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e51a4c93-4d23-59f6-a7f4-57020d6fcf83 with identifier: YX64853 to the API
2026-03-28 07:33:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:28:32Z',
'fuel_type': 'petrol',
'id': 'e51a4c93-4d23-59f6-a7f4-57020d6fcf83',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX64853',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 96982,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-23',
'seller_name': None,
'title': 'Volkswagen Polo 1.6 United',
'transmission': 'manual',
'trim': 'United',
'year': 2009}
2026-03-28 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX64853%27 HTTP/1.1" 200 None
2026-03-28 07:33:30 [auto1.de] INFO: Saving data for YX64853: {'auction_closing_time': 1774715312.0, 'created_time': 1774467156.304528, 'last_price_update_time': 1774683210.201183}
2026-03-28 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YX64853') HTTP/1.1" 204 0
2026-03-28 07:33:30 [auto1.de] INFO: Found listing with ID: XL73598
2026-03-28 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL73598%27 HTTP/1.1" 200 None
2026-03-28 07:33:30 [auto1.de] INFO: Scrape type for XL73598: 0
2026-03-28 07:33:30 [auto1.de] INFO: Found listing with ID: TS72437
2026-03-28 07:33:30 [auto1.de] INFO: Found listing with ID: KB41878
2026-03-28 07:33:30 [auto1.de] INFO: Found listing with ID: NB19149
2026-03-28 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB19149%27 HTTP/1.1" 200 None
2026-03-28 07:33:30 [auto1.de] INFO: Scrape type for NB19149: 0
2026-03-28 07:33:30 [auto1.de] INFO: Found listing with ID: NM18841
2026-03-28 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM18841%27 HTTP/1.1" 200 None
2026-03-28 07:33:30 [auto1.de] INFO: Scrape type for NM18841: 2
2026-03-28 07:33:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98a39acc-92fa-5a50-92a0-354d30cf73f2 with identifier: NM18841
2026-03-28 07:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98a39acc-92fa-5a50-92a0-354d30cf73f2 with scrape type 2
2026-03-28 07:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98a39acc-92fa-5a50-92a0-354d30cf73f2 with scrape type 2
2026-03-28 07:33:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98a39acc-92fa-5a50-92a0-354d30cf73f2, identifier: NM18841
2026-03-28 07:33:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98a39acc-92fa-5a50-92a0-354d30cf73f2 with identifier: NM18841
2026-03-28 07:33:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98a39acc-92fa-5a50-92a0-354d30cf73f2 with identifier: NM18841
2026-03-28 07:33:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98a39acc-92fa-5a50-92a0-354d30cf73f2 with identifier: NM18841 to the API
2026-03-28 07:33:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 76,
'expiration_date': '2026-03-28T16:50:28Z',
'fuel_type': 'petrol',
'id': '98a39acc-92fa-5a50-92a0-354d30cf73f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM18841',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 59023,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-22',
'seller_name': None,
'title': 'Renault Clio 0.9 TCe Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2019}
2026-03-28 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM18841%27 HTTP/1.1" 200 None
2026-03-28 07:33:30 [auto1.de] INFO: Saving data for NM18841: {'auction_closing_time': 1774716628.0, 'created_time': 1774466885.912186, 'last_price_update_time': 1774683210.748618}
2026-03-28 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NM18841') HTTP/1.1" 204 0
2026-03-28 07:33:30 [auto1.de] INFO: Found listing with ID: EB09552
2026-03-28 07:33:30 [auto1.de] INFO: Found listing with ID: BA95862
2026-03-28 07:33:30 [auto1.de] INFO: Found listing with ID: XF39485
2026-03-28 07:33:30 [auto1.de] INFO: Found listing with ID: FH78199
2026-03-28 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH78199%27 HTTP/1.1" 200 None
2026-03-28 07:33:30 [auto1.de] INFO: Scrape type for FH78199: 2
2026-03-28 07:33:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 949afb66-ccbe-507c-bea1-ee8f0ab6cb20 with identifier: FH78199
2026-03-28 07:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 949afb66-ccbe-507c-bea1-ee8f0ab6cb20 with scrape type 2
2026-03-28 07:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 949afb66-ccbe-507c-bea1-ee8f0ab6cb20 with scrape type 2
2026-03-28 07:33:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 949afb66-ccbe-507c-bea1-ee8f0ab6cb20, identifier: FH78199
2026-03-28 07:33:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 949afb66-ccbe-507c-bea1-ee8f0ab6cb20 with identifier: FH78199
2026-03-28 07:33:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 949afb66-ccbe-507c-bea1-ee8f0ab6cb20 with identifier: FH78199
2026-03-28 07:33:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 949afb66-ccbe-507c-bea1-ee8f0ab6cb20 with identifier: FH78199 to the API
2026-03-28 07:33:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 129,
'expiration_date': '2026-03-28T16:29:46Z',
'fuel_type': 'petrol',
'id': '949afb66-ccbe-507c-bea1-ee8f0ab6cb20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH78199',
'listing': 'auction',
'make': 'Suzuki',
'model': 'SX4 S-Cross',
'odometer': 120952,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-28',
'seller_name': None,
'title': 'Suzuki SX4 S-Cross 1.4 BoosterJet Mild-Hybrid Comfort+ 4x4',
'transmission': 'automatic',
'trim': 'Comfort+ 4x4',
'year': 2016}
2026-03-28 07:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH78199%27 HTTP/1.1" 200 None
2026-03-28 07:33:31 [auto1.de] INFO: Saving data for FH78199: {'auction_closing_time': 1774715386.0, 'created_time': 1774468009.97059, 'last_price_update_time': 1774683211.57999}
2026-03-28 07:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH78199') HTTP/1.1" 204 0
2026-03-28 07:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:33:31 [auto1.de] INFO: Found listing with ID: NG85198
2026-03-28 07:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG85198%27 HTTP/1.1" 200 None
2026-03-28 07:33:31 [auto1.de] INFO: Scrape type for NG85198: 2
2026-03-28 07:33:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86d10a8b-2788-5772-a05f-ef2f4bb8897c with identifier: NG85198
2026-03-28 07:33:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86d10a8b-2788-5772-a05f-ef2f4bb8897c with scrape type 2
2026-03-28 07:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86d10a8b-2788-5772-a05f-ef2f4bb8897c with scrape type 2
2026-03-28 07:33:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86d10a8b-2788-5772-a05f-ef2f4bb8897c, identifier: NG85198
2026-03-28 07:33:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86d10a8b-2788-5772-a05f-ef2f4bb8897c with identifier: NG85198
2026-03-28 07:33:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86d10a8b-2788-5772-a05f-ef2f4bb8897c with identifier: NG85198
2026-03-28 07:33:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86d10a8b-2788-5772-a05f-ef2f4bb8897c with identifier: NG85198 to the API
2026-03-28 07:33:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-28T16:33:31Z',
'fuel_type': 'petrol',
'id': '86d10a8b-2788-5772-a05f-ef2f4bb8897c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG85198',
'listing': 'auction',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 148756,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-20',
'seller_name': None,
'title': 'Toyota Aygo 1.0 Cool',
'transmission': 'manual',
'trim': 'Cool',
'year': 2012}
2026-03-28 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG85198%27 HTTP/1.1" 200 None
2026-03-28 07:33:32 [auto1.de] INFO: Saving data for NG85198: {'auction_closing_time': 1774715611.0, 'created_time': 1773829882.880506, 'last_price_update_time': 1774683212.53063}
2026-03-28 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG85198') HTTP/1.1" 204 0
2026-03-28 07:33:32 [auto1.de] INFO: Found listing with ID: ZC45709
2026-03-28 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC45709%27 HTTP/1.1" 200 None
2026-03-28 07:33:32 [auto1.de] INFO: Scrape type for ZC45709: 2
2026-03-28 07:33:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68a5fda9-9863-5208-b379-850c688daf54 with identifier: ZC45709
2026-03-28 07:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68a5fda9-9863-5208-b379-850c688daf54 with scrape type 2
2026-03-28 07:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68a5fda9-9863-5208-b379-850c688daf54 with scrape type 2
2026-03-28 07:33:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68a5fda9-9863-5208-b379-850c688daf54, identifier: ZC45709
2026-03-28 07:33:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68a5fda9-9863-5208-b379-850c688daf54 with identifier: ZC45709
2026-03-28 07:33:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68a5fda9-9863-5208-b379-850c688daf54 with identifier: ZC45709
2026-03-28 07:33:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68a5fda9-9863-5208-b379-850c688daf54 with identifier: ZC45709 to the API
2026-03-28 07:33:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:46:49Z',
'fuel_type': 'petrol',
'id': '68a5fda9-9863-5208-b379-850c688daf54',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC45709',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Giulietta',
'odometer': 116817,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-13',
'seller_name': None,
'title': 'Alfa Romeo Giulietta 1.4 Turbo Super',
'transmission': 'automatic',
'trim': 'Super',
'year': 2018}
2026-03-28 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC45709%27 HTTP/1.1" 200 None
2026-03-28 07:33:32 [auto1.de] INFO: Saving data for ZC45709: {'auction_closing_time': 1774716409.0, 'created_time': 1774467266.619659, 'last_price_update_time': 1774683212.963363}
2026-03-28 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC45709') HTTP/1.1" 204 0
2026-03-28 07:33:32 [auto1.de] INFO: Channel: 24h | Page: 35 | totalHits: 9251 | hits on page: 40
2026-03-28 07:33:32 [auto1.de] INFO: Found listing with ID: LM64010
2026-03-28 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM64010%27 HTTP/1.1" 200 None
2026-03-28 07:33:32 [auto1.de] INFO: Scrape type for LM64010: 0
2026-03-28 07:33:32 [auto1.de] INFO: Found listing with ID: WZ32773
2026-03-28 07:33:32 [auto1.de] INFO: Found listing with ID: ZL42149
2026-03-28 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL42149%27 HTTP/1.1" 200 None
2026-03-28 07:33:33 [auto1.de] INFO: Scrape type for ZL42149: 2
2026-03-28 07:33:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50062311-eaec-50ce-82a8-cb2b4b6f0562 with identifier: ZL42149
2026-03-28 07:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50062311-eaec-50ce-82a8-cb2b4b6f0562 with scrape type 2
2026-03-28 07:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50062311-eaec-50ce-82a8-cb2b4b6f0562 with scrape type 2
2026-03-28 07:33:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50062311-eaec-50ce-82a8-cb2b4b6f0562, identifier: ZL42149
2026-03-28 07:33:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:33:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50062311-eaec-50ce-82a8-cb2b4b6f0562 with identifier: ZL42149
2026-03-28 07:33:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50062311-eaec-50ce-82a8-cb2b4b6f0562 with identifier: ZL42149
2026-03-28 07:33:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50062311-eaec-50ce-82a8-cb2b4b6f0562 with identifier: ZL42149 to the API
2026-03-28 07:33:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:59:53Z',
'fuel_type': 'diesel',
'id': '50062311-eaec-50ce-82a8-cb2b4b6f0562',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL42149',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 218353,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-10-28',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 CDI BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'BlueEfficiency Avantgarde',
'year': 2010}
2026-03-28 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL42149%27 HTTP/1.1" 200 None
2026-03-28 07:33:33 [auto1.de] INFO: Saving data for ZL42149: {'auction_closing_time': 1774717193.0, 'created_time': 1773860950.543999, 'last_price_update_time': 1774683213.441152}
2026-03-28 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL42149') HTTP/1.1" 204 0
2026-03-28 07:33:33 [auto1.de] INFO: Found listing with ID: AB54193
2026-03-28 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB54193%27 HTTP/1.1" 200 None
2026-03-28 07:33:33 [auto1.de] INFO: Scrape type for AB54193: 2
2026-03-28 07:33:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b318179-5c86-58e2-892e-81fa7b40b94a with identifier: AB54193
2026-03-28 07:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b318179-5c86-58e2-892e-81fa7b40b94a with scrape type 2
2026-03-28 07:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b318179-5c86-58e2-892e-81fa7b40b94a with scrape type 2
2026-03-28 07:33:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b318179-5c86-58e2-892e-81fa7b40b94a, identifier: AB54193
2026-03-28 07:33:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b318179-5c86-58e2-892e-81fa7b40b94a with identifier: AB54193
2026-03-28 07:33:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b318179-5c86-58e2-892e-81fa7b40b94a with identifier: AB54193
2026-03-28 07:33:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b318179-5c86-58e2-892e-81fa7b40b94a with identifier: AB54193 to the API
2026-03-28 07:33:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:00:07Z',
'fuel_type': 'diesel',
'id': '3b318179-5c86-58e2-892e-81fa7b40b94a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB54193',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 96276,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-01',
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Generation Six',
'transmission': 'automatic',
'trim': 'Generation Six',
'year': 2018}
2026-03-28 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB54193%27 HTTP/1.1" 200 None
2026-03-28 07:33:33 [auto1.de] INFO: Saving data for AB54193: {'auction_closing_time': 1774713607.0, 'created_time': 1774468105.333332, 'last_price_update_time': 1774683213.867327}
2026-03-28 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB54193') HTTP/1.1" 204 0
2026-03-28 07:33:33 [auto1.de] INFO: Found listing with ID: AN39214
2026-03-28 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN39214%27 HTTP/1.1" 200 None
2026-03-28 07:33:33 [auto1.de] INFO: Scrape type for AN39214: 0
2026-03-28 07:33:33 [auto1.de] INFO: Found listing with ID: EX27277
2026-03-28 07:33:33 [auto1.de] INFO: Found listing with ID: UA60360
2026-03-28 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA60360%27 HTTP/1.1" 200 None
2026-03-28 07:33:33 [auto1.de] INFO: Scrape type for UA60360: 0
2026-03-28 07:33:33 [auto1.de] INFO: Found listing with ID: TL07964
2026-03-28 07:33:33 [auto1.de] INFO: Found listing with ID: LW16241
2026-03-28 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW16241%27 HTTP/1.1" 200 None
2026-03-28 07:33:33 [auto1.de] INFO: Scrape type for LW16241: 2
2026-03-28 07:33:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c28c361c-95d8-5bc0-97f7-50719167a0d3 with identifier: LW16241
2026-03-28 07:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c28c361c-95d8-5bc0-97f7-50719167a0d3 with scrape type 2
2026-03-28 07:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c28c361c-95d8-5bc0-97f7-50719167a0d3 with scrape type 2
2026-03-28 07:33:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c28c361c-95d8-5bc0-97f7-50719167a0d3, identifier: LW16241
2026-03-28 07:33:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c28c361c-95d8-5bc0-97f7-50719167a0d3 with identifier: LW16241
2026-03-28 07:33:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c28c361c-95d8-5bc0-97f7-50719167a0d3 with identifier: LW16241
2026-03-28 07:33:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c28c361c-95d8-5bc0-97f7-50719167a0d3 with identifier: LW16241 to the API
2026-03-28 07:33:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:50:31Z',
'fuel_type': 'petrol',
'id': 'c28c361c-95d8-5bc0-97f7-50719167a0d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW16241',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 89205,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-07',
'seller_name': None,
'title': 'Dacia Duster 1.2 TCe Black Shadow 4x2',
'transmission': 'manual',
'trim': 'Black Shadow 4x2',
'year': 2017}
2026-03-28 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW16241%27 HTTP/1.1" 200 None
2026-03-28 07:33:34 [auto1.de] INFO: Saving data for LW16241: {'auction_closing_time': 1774716631.0, 'created_time': 1774503049.998186, 'last_price_update_time': 1774683214.357805}
2026-03-28 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW16241') HTTP/1.1" 204 0
2026-03-28 07:33:34 [auto1.de] INFO: Found listing with ID: HZ35623
2026-03-28 07:33:34 [auto1.de] INFO: Found listing with ID: AV36949
2026-03-28 07:33:34 [auto1.de] INFO: Found listing with ID: HE50023
2026-03-28 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE50023%27 HTTP/1.1" 200 None
2026-03-28 07:33:34 [auto1.de] INFO: Scrape type for HE50023: 2
2026-03-28 07:33:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8269f8ee-8188-536c-bf20-858c5eef4155 with identifier: HE50023
2026-03-28 07:33:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8269f8ee-8188-536c-bf20-858c5eef4155 with scrape type 2
2026-03-28 07:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8269f8ee-8188-536c-bf20-858c5eef4155 with scrape type 2
2026-03-28 07:33:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8269f8ee-8188-536c-bf20-858c5eef4155, identifier: HE50023
2026-03-28 07:33:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8269f8ee-8188-536c-bf20-858c5eef4155 with identifier: HE50023
2026-03-28 07:33:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8269f8ee-8188-536c-bf20-858c5eef4155 with identifier: HE50023
2026-03-28 07:33:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8269f8ee-8188-536c-bf20-858c5eef4155 with identifier: HE50023 to the API
2026-03-28 07:33:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:56:00Z',
'fuel_type': 'diesel',
'id': '8269f8ee-8188-536c-bf20-858c5eef4155',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE50023',
'listing': 'auction',
'make': 'Audi',
'model': 'TT',
'odometer': 122480,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-24',
'seller_name': None,
'title': 'Audi TT 2.0 TDI quattro Coupe',
'transmission': 'manual',
'trim': 'quattro Coupe',
'year': 2014}
2026-03-28 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE50023%27 HTTP/1.1" 200 None
2026-03-28 07:33:34 [auto1.de] INFO: Saving data for HE50023: {'auction_closing_time': 1774716960.0, 'created_time': 1774464128.327091, 'last_price_update_time': 1774683214.873812}
2026-03-28 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE50023') HTTP/1.1" 204 0
2026-03-28 07:33:34 [auto1.de] INFO: Found listing with ID: HC69827
2026-03-28 07:33:34 [auto1.de] INFO: Found listing with ID: KW68340
2026-03-28 07:33:34 [auto1.de] INFO: Found listing with ID: UK52286
2026-03-28 07:33:34 [auto1.de] INFO: Found listing with ID: ML58643
2026-03-28 07:33:34 [auto1.de] INFO: Found listing with ID: XU25249
2026-03-28 07:33:34 [auto1.de] INFO: Found listing with ID: NF91521
2026-03-28 07:33:34 [auto1.de] INFO: Found listing with ID: WD57497
2026-03-28 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD57497%27 HTTP/1.1" 200 None
2026-03-28 07:33:34 [auto1.de] INFO: Scrape type for WD57497: 0
2026-03-28 07:33:34 [auto1.de] INFO: Found listing with ID: VR97346
2026-03-28 07:33:34 [auto1.de] INFO: Found listing with ID: NZ77836
2026-03-28 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ77836%27 HTTP/1.1" 200 None
2026-03-28 07:33:34 [auto1.de] INFO: Scrape type for NZ77836: 0
2026-03-28 07:33:34 [auto1.de] INFO: Found listing with ID: RH08953
2026-03-28 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH08953%27 HTTP/1.1" 200 None
2026-03-28 07:33:34 [auto1.de] INFO: Scrape type for RH08953: 0
2026-03-28 07:33:34 [auto1.de] INFO: Found listing with ID: KS00518
2026-03-28 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS00518%27 HTTP/1.1" 200 None
2026-03-28 07:33:34 [auto1.de] INFO: Scrape type for KS00518: 2
2026-03-28 07:33:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6583a1d4-f811-54d7-a256-29663a31c874 with identifier: KS00518
2026-03-28 07:33:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6583a1d4-f811-54d7-a256-29663a31c874 with scrape type 2
2026-03-28 07:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6583a1d4-f811-54d7-a256-29663a31c874 with scrape type 2
2026-03-28 07:33:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6583a1d4-f811-54d7-a256-29663a31c874, identifier: KS00518
2026-03-28 07:33:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6583a1d4-f811-54d7-a256-29663a31c874 with identifier: KS00518
2026-03-28 07:33:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6583a1d4-f811-54d7-a256-29663a31c874 with identifier: KS00518
2026-03-28 07:33:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6583a1d4-f811-54d7-a256-29663a31c874 with identifier: KS00518 to the API
2026-03-28 07:33:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:04:00Z',
'fuel_type': 'petrol',
'id': '6583a1d4-f811-54d7-a256-29663a31c874',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS00518',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 324629,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-29',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2010}
2026-03-28 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS00518%27 HTTP/1.1" 200 None
2026-03-28 07:33:35 [auto1.de] INFO: Saving data for KS00518: {'auction_closing_time': 1774713840.0, 'created_time': 1774467517.037939, 'last_price_update_time': 1774683215.577351}
2026-03-28 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS00518') HTTP/1.1" 204 0
2026-03-28 07:33:35 [auto1.de] INFO: Found listing with ID: FK00341
2026-03-28 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK00341%27 HTTP/1.1" 200 None
2026-03-28 07:33:35 [auto1.de] INFO: Scrape type for FK00341: 0
2026-03-28 07:33:35 [auto1.de] INFO: Found listing with ID: JP67472
2026-03-28 07:33:35 [auto1.de] INFO: Found listing with ID: TS09067
2026-03-28 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS09067%27 HTTP/1.1" 200 None
2026-03-28 07:33:35 [auto1.de] INFO: Scrape type for TS09067: 0
2026-03-28 07:33:35 [auto1.de] INFO: Found listing with ID: ES63389
2026-03-28 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES63389%27 HTTP/1.1" 200 None
2026-03-28 07:33:35 [auto1.de] INFO: Scrape type for ES63389: 0
2026-03-28 07:33:35 [auto1.de] INFO: Found listing with ID: YT31718
2026-03-28 07:33:35 [auto1.de] INFO: Found listing with ID: SH15635
2026-03-28 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH15635%27 HTTP/1.1" 200 None
2026-03-28 07:33:35 [auto1.de] INFO: Scrape type for SH15635: 2
2026-03-28 07:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87477fd6-bb20-5e91-88d7-c92419076a62 with identifier: SH15635
2026-03-28 07:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87477fd6-bb20-5e91-88d7-c92419076a62 with scrape type 2
2026-03-28 07:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87477fd6-bb20-5e91-88d7-c92419076a62 with scrape type 2
2026-03-28 07:33:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87477fd6-bb20-5e91-88d7-c92419076a62, identifier: SH15635
2026-03-28 07:33:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87477fd6-bb20-5e91-88d7-c92419076a62 with identifier: SH15635
2026-03-28 07:33:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87477fd6-bb20-5e91-88d7-c92419076a62 with identifier: SH15635
2026-03-28 07:33:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87477fd6-bb20-5e91-88d7-c92419076a62 with identifier: SH15635 to the API
2026-03-28 07:33:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:43:05Z',
'fuel_type': 'diesel',
'id': '87477fd6-bb20-5e91-88d7-c92419076a62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH15635',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 112218,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-27',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 d',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-03-28 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH15635%27 HTTP/1.1" 200 None
2026-03-28 07:33:36 [auto1.de] INFO: Saving data for SH15635: {'auction_closing_time': 1774716185.0, 'created_time': 1773898266.31275, 'last_price_update_time': 1774683216.165413}
2026-03-28 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SH15635') HTTP/1.1" 204 0
2026-03-28 07:33:36 [auto1.de] INFO: Found listing with ID: XJ09013
2026-03-28 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ09013%27 HTTP/1.1" 200 None
2026-03-28 07:33:36 [auto1.de] INFO: Scrape type for XJ09013: 0
2026-03-28 07:33:36 [auto1.de] INFO: Found listing with ID: HX06871
2026-03-28 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX06871%27 HTTP/1.1" 200 None
2026-03-28 07:33:36 [auto1.de] INFO: Scrape type for HX06871: 0
2026-03-28 07:33:36 [auto1.de] INFO: Found listing with ID: NG89372
2026-03-28 07:33:36 [auto1.de] INFO: Found listing with ID: EA13854
2026-03-28 07:33:36 [auto1.de] INFO: Found listing with ID: BJ62941
2026-03-28 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ62941%27 HTTP/1.1" 200 None
2026-03-28 07:33:36 [auto1.de] INFO: Scrape type for BJ62941: 0
2026-03-28 07:33:36 [auto1.de] INFO: Found listing with ID: ZR46884
2026-03-28 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR46884%27 HTTP/1.1" 200 None
2026-03-28 07:33:36 [auto1.de] INFO: Scrape type for ZR46884: 0
2026-03-28 07:33:36 [auto1.de] INFO: Found listing with ID: YP80343
2026-03-28 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP80343%27 HTTP/1.1" 200 None
2026-03-28 07:33:36 [auto1.de] INFO: Scrape type for YP80343: 2
2026-03-28 07:33:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5787999a-0f04-5817-91ba-280654497763 with identifier: YP80343
2026-03-28 07:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5787999a-0f04-5817-91ba-280654497763 with scrape type 2
2026-03-28 07:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5787999a-0f04-5817-91ba-280654497763 with scrape type 2
2026-03-28 07:33:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5787999a-0f04-5817-91ba-280654497763, identifier: YP80343
2026-03-28 07:33:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5787999a-0f04-5817-91ba-280654497763 with identifier: YP80343
2026-03-28 07:33:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5787999a-0f04-5817-91ba-280654497763 with identifier: YP80343
2026-03-28 07:33:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5787999a-0f04-5817-91ba-280654497763 with identifier: YP80343 to the API
2026-03-28 07:33:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 117,
'expiration_date': '2026-03-28T16:07:57Z',
'fuel_type': 'petrol',
'id': '5787999a-0f04-5817-91ba-280654497763',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP80343',
'listing': 'auction',
'make': 'Nissan',
'model': 'Juke',
'odometer': 133150,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-28',
'seller_name': None,
'title': 'Nissan Juke 1.6 Ministry of Sound',
'transmission': 'manual',
'trim': 'Ministry of Sound',
'year': 2013}
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP80343%27 HTTP/1.1" 200 None
2026-03-28 07:33:37 [auto1.de] INFO: Saving data for YP80343: {'auction_closing_time': 1774714077.0, 'created_time': 1773859463.948268, 'last_price_update_time': 1774683217.036005}
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP80343') HTTP/1.1" 204 0
2026-03-28 07:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: ZA93244
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: AB71807
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: TJ52471
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ52471%27 HTTP/1.1" 200 None
2026-03-28 07:33:37 [auto1.de] INFO: Scrape type for TJ52471: 0
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: CW94912
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: GL98026
2026-03-28 07:33:37 [auto1.de] INFO: Channel: 24h | Page: 36 | totalHits: 9251 | hits on page: 40
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: YJ47814
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ47814%27 HTTP/1.1" 200 None
2026-03-28 07:33:37 [auto1.de] INFO: Scrape type for YJ47814: 0
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: TH04354
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH04354%27 HTTP/1.1" 200 None
2026-03-28 07:33:37 [auto1.de] INFO: Scrape type for TH04354: 0
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: GZ39772
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: TD61700
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: CZ36938
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: RB04302
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: JR64740
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR64740%27 HTTP/1.1" 200 None
2026-03-28 07:33:37 [auto1.de] INFO: Scrape type for JR64740: 0
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: UX27196
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX27196%27 HTTP/1.1" 200 None
2026-03-28 07:33:37 [auto1.de] INFO: Scrape type for UX27196: 2
2026-03-28 07:33:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3adae0b6-320e-5176-91b5-3f6c793f01b5 with identifier: UX27196
2026-03-28 07:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3adae0b6-320e-5176-91b5-3f6c793f01b5 with scrape type 2
2026-03-28 07:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3adae0b6-320e-5176-91b5-3f6c793f01b5 with scrape type 2
2026-03-28 07:33:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3adae0b6-320e-5176-91b5-3f6c793f01b5, identifier: UX27196
2026-03-28 07:33:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3adae0b6-320e-5176-91b5-3f6c793f01b5 with identifier: UX27196
2026-03-28 07:33:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3adae0b6-320e-5176-91b5-3f6c793f01b5 with identifier: UX27196
2026-03-28 07:33:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3adae0b6-320e-5176-91b5-3f6c793f01b5 with identifier: UX27196 to the API
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 129,
'expiration_date': '2026-03-28T16:31:38Z',
'fuel_type': 'petrol',
'id': '3adae0b6-320e-5176-91b5-3f6c793f01b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX27196',
'listing': 'auction',
'make': 'Suzuki',
'model': 'S-Cross',
'odometer': 13758,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-24',
'seller_name': None,
'title': 'Suzuki S-Cross 1.4 BoosterJet Mild-Hybrid ALLGRIP Comfort+',
'transmission': 'manual',
'trim': 'ALLGRIP Comfort+',
'year': 2023}
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX27196%27 HTTP/1.1" 200 None
2026-03-28 07:33:37 [auto1.de] INFO: Saving data for UX27196: {'auction_closing_time': 1774715498.0, 'created_time': 1773859471.307035, 'last_price_update_time': 1774683217.732966}
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX27196') HTTP/1.1" 204 0
2026-03-28 07:33:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: DY53680
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: DW82351
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW82351%27 HTTP/1.1" 200 None
2026-03-28 07:33:37 [auto1.de] INFO: Scrape type for DW82351: 0
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: XU08667
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: WD16900
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: SM94755
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM94755%27 HTTP/1.1" 200 None
2026-03-28 07:33:37 [auto1.de] INFO: Scrape type for SM94755: 0
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: RA48340
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: LM34765
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM34765%27 HTTP/1.1" 200 None
2026-03-28 07:33:37 [auto1.de] INFO: Scrape type for LM34765: 0
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: GS63097
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: AU85949
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: AP70373
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: DC45609
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC45609%27 HTTP/1.1" 200 None
2026-03-28 07:33:37 [auto1.de] INFO: Scrape type for DC45609: 0
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: FK07385
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK07385%27 HTTP/1.1" 200 None
2026-03-28 07:33:37 [auto1.de] INFO: Scrape type for FK07385: 0
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: ZJ58005
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ58005%27 HTTP/1.1" 200 None
2026-03-28 07:33:37 [auto1.de] INFO: Scrape type for ZJ58005: 0
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: ER69054
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER69054%27 HTTP/1.1" 200 None
2026-03-28 07:33:37 [auto1.de] INFO: Scrape type for ER69054: 0
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: NE18994
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: WT90781
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: SE64605
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE64605%27 HTTP/1.1" 200 None
2026-03-28 07:33:37 [auto1.de] INFO: Scrape type for SE64605: 0
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: UR14264
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: FX62858
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX62858%27 HTTP/1.1" 200 None
2026-03-28 07:33:37 [auto1.de] INFO: Scrape type for FX62858: 0
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: FJ58428
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ58428%27 HTTP/1.1" 200 None
2026-03-28 07:33:37 [auto1.de] INFO: Scrape type for FJ58428: 0
2026-03-28 07:33:37 [auto1.de] INFO: Found listing with ID: UZ81937
2026-03-28 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ81937%27 HTTP/1.1" 200 None
2026-03-28 07:33:38 [auto1.de] INFO: Scrape type for UZ81937: 0
2026-03-28 07:33:38 [auto1.de] INFO: Found listing with ID: RP43844
2026-03-28 07:33:38 [auto1.de] INFO: Found listing with ID: TW15848
2026-03-28 07:33:38 [auto1.de] INFO: Found listing with ID: TS91087
2026-03-28 07:33:38 [auto1.de] INFO: Found listing with ID: CS76410
2026-03-28 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS76410%27 HTTP/1.1" 200 None
2026-03-28 07:33:38 [auto1.de] INFO: Scrape type for CS76410: 0
2026-03-28 07:33:38 [auto1.de] INFO: Found listing with ID: FC74080
2026-03-28 07:33:38 [auto1.de] INFO: Found listing with ID: DW77262
2026-03-28 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77262%27 HTTP/1.1" 200 None
2026-03-28 07:33:38 [auto1.de] INFO: Scrape type for DW77262: 0
2026-03-28 07:33:38 [auto1.de] INFO: Found listing with ID: RZ52182
2026-03-28 07:33:38 [auto1.de] INFO: Found listing with ID: FT31566
2026-03-28 07:33:38 [auto1.de] INFO: Found listing with ID: LU79813
2026-03-28 07:33:38 [auto1.de] INFO: Found listing with ID: NV48400
2026-03-28 07:33:38 [auto1.de] INFO: Found listing with ID: EW06930
2026-03-28 07:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:33:45 [auto1.de] INFO: Channel: 24h | Page: 37 | totalHits: 9251 | hits on page: 40
2026-03-28 07:33:45 [auto1.de] INFO: Found listing with ID: RX22945
2026-03-28 07:33:45 [auto1.de] INFO: Found listing with ID: DX24804
2026-03-28 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX24804%27 HTTP/1.1" 200 None
2026-03-28 07:33:45 [auto1.de] INFO: Scrape type for DX24804: 0
2026-03-28 07:33:45 [auto1.de] INFO: Found listing with ID: EN59108
2026-03-28 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN59108%27 HTTP/1.1" 200 None
2026-03-28 07:33:45 [auto1.de] INFO: Scrape type for EN59108: 2
2026-03-28 07:33:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7cd3525-833d-526a-937f-04639ee45124 with identifier: EN59108
2026-03-28 07:33:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7cd3525-833d-526a-937f-04639ee45124 with scrape type 2
2026-03-28 07:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7cd3525-833d-526a-937f-04639ee45124 with scrape type 2
2026-03-28 07:33:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7cd3525-833d-526a-937f-04639ee45124, identifier: EN59108
2026-03-28 07:33:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7cd3525-833d-526a-937f-04639ee45124 with identifier: EN59108
2026-03-28 07:33:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7cd3525-833d-526a-937f-04639ee45124 with identifier: EN59108
2026-03-28 07:33:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7cd3525-833d-526a-937f-04639ee45124 with identifier: EN59108 to the API
2026-03-28 07:33:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:23:48Z',
'fuel_type': 'diesel',
'id': 'b7cd3525-833d-526a-937f-04639ee45124',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN59108',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 226532,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-27',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC',
'transmission': 'manual',
'trim': 'T BlueTEC',
'year': 2017}
2026-03-28 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN59108%27 HTTP/1.1" 200 None
2026-03-28 07:33:46 [auto1.de] INFO: Saving data for EN59108: {'auction_closing_time': 1774715028.0, 'created_time': 1774463725.785941, 'last_price_update_time': 1774683226.233824}
2026-03-28 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN59108') HTTP/1.1" 204 0
2026-03-28 07:33:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:33:46 [auto1.de] INFO: Found listing with ID: ST98775
2026-03-28 07:33:46 [auto1.de] INFO: Found listing with ID: VF93957
2026-03-28 07:33:46 [auto1.de] INFO: Found listing with ID: EW00282
2026-03-28 07:33:46 [auto1.de] INFO: Found listing with ID: BW06132
2026-03-28 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW06132%27 HTTP/1.1" 200 None
2026-03-28 07:33:46 [auto1.de] INFO: Scrape type for BW06132: 0
2026-03-28 07:33:46 [auto1.de] INFO: Found listing with ID: ZV14288
2026-03-28 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV14288%27 HTTP/1.1" 200 None
2026-03-28 07:33:46 [auto1.de] INFO: Scrape type for ZV14288: 0
2026-03-28 07:33:46 [auto1.de] INFO: Found listing with ID: GS49465
2026-03-28 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS49465%27 HTTP/1.1" 200 None
2026-03-28 07:33:46 [auto1.de] INFO: Scrape type for GS49465: 0
2026-03-28 07:33:46 [auto1.de] INFO: Found listing with ID: UR69038
2026-03-28 07:33:46 [auto1.de] INFO: Found listing with ID: VJ26450
2026-03-28 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ26450%27 HTTP/1.1" 200 None
2026-03-28 07:33:46 [auto1.de] INFO: Scrape type for VJ26450: 0
2026-03-28 07:33:46 [auto1.de] INFO: Found listing with ID: VK29139
2026-03-28 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK29139%27 HTTP/1.1" 200 None
2026-03-28 07:33:46 [auto1.de] INFO: Scrape type for VK29139: 2
2026-03-28 07:33:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 606a9001-17d0-5271-8e73-4696ca70987e with identifier: VK29139
2026-03-28 07:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 606a9001-17d0-5271-8e73-4696ca70987e with scrape type 2
2026-03-28 07:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 606a9001-17d0-5271-8e73-4696ca70987e with scrape type 2
2026-03-28 07:33:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 606a9001-17d0-5271-8e73-4696ca70987e, identifier: VK29139
2026-03-28 07:33:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 606a9001-17d0-5271-8e73-4696ca70987e with identifier: VK29139
2026-03-28 07:33:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 606a9001-17d0-5271-8e73-4696ca70987e with identifier: VK29139
2026-03-28 07:33:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 606a9001-17d0-5271-8e73-4696ca70987e with identifier: VK29139 to the API
2026-03-28 07:33:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:17:15Z',
'fuel_type': 'petrol',
'id': '606a9001-17d0-5271-8e73-4696ca70987e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK29139',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 176906,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-27',
'seller_name': None,
'title': 'Opel Astra 1.4 Turbo Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2013}
2026-03-28 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK29139%27 HTTP/1.1" 200 None
2026-03-28 07:33:47 [auto1.de] INFO: Saving data for VK29139: {'auction_closing_time': 1774714635.0, 'created_time': 1774465842.3876579, 'last_price_update_time': 1774683227.405702}
2026-03-28 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK29139') HTTP/1.1" 204 0
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: DW05211
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: KZ84912
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: CR80817
2026-03-28 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR80817%27 HTTP/1.1" 200 None
2026-03-28 07:33:47 [auto1.de] INFO: Scrape type for CR80817: 0
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: CF81636
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: GD73586
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: FA74860
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: GB26744
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: WW55400
2026-03-28 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW55400%27 HTTP/1.1" 200 None
2026-03-28 07:33:47 [auto1.de] INFO: Scrape type for WW55400: 0
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: RV71441
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: BA95413
2026-03-28 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA95413%27 HTTP/1.1" 200 None
2026-03-28 07:33:47 [auto1.de] INFO: Scrape type for BA95413: 0
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: PR29926
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: BV83779
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: HM11779
2026-03-28 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM11779%27 HTTP/1.1" 200 None
2026-03-28 07:33:47 [auto1.de] INFO: Scrape type for HM11779: 0
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: FA89686
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: KB32538
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: CF22867
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: VL77051
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: MZ57576
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: LN58071
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: MZ60723
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: DU90887
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: NB32533
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: LR77482
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: TY77956
2026-03-28 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY77956%27 HTTP/1.1" 200 None
2026-03-28 07:33:47 [auto1.de] INFO: Scrape type for TY77956: 0
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: NC83571
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: MA82889
2026-03-28 07:33:47 [auto1.de] INFO: Found listing with ID: EG84867
2026-03-28 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG84867%27 HTTP/1.1" 200 None
2026-03-28 07:33:47 [auto1.de] INFO: Scrape type for EG84867: 2
2026-03-28 07:33:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f98f522e-54c6-505c-b227-0c217fdfc925 with identifier: EG84867
2026-03-28 07:33:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f98f522e-54c6-505c-b227-0c217fdfc925 with scrape type 2
2026-03-28 07:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f98f522e-54c6-505c-b227-0c217fdfc925 with scrape type 2
2026-03-28 07:33:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f98f522e-54c6-505c-b227-0c217fdfc925, identifier: EG84867
2026-03-28 07:33:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f98f522e-54c6-505c-b227-0c217fdfc925 with identifier: EG84867
2026-03-28 07:33:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f98f522e-54c6-505c-b227-0c217fdfc925 with identifier: EG84867
2026-03-28 07:33:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f98f522e-54c6-505c-b227-0c217fdfc925 with identifier: EG84867 to the API
2026-03-28 07:33:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-28T16:21:07Z',
'fuel_type': 'diesel',
'id': 'f98f522e-54c6-505c-b227-0c217fdfc925',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG84867',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 192845,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-18',
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2016}
2026-03-28 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG84867%27 HTTP/1.1" 200 None
2026-03-28 07:33:47 [auto1.de] INFO: Saving data for EG84867: {'auction_closing_time': 1774714867.0, 'created_time': 1774468077.727829, 'last_price_update_time': 1774683227.941714}
2026-03-28 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG84867') HTTP/1.1" 204 0
2026-03-28 07:33:48 [auto1.de] INFO: Found listing with ID: VN62534
2026-03-28 07:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:33:49 [auto1.de] INFO: Channel: 24h | Page: 38 | totalHits: 9251 | hits on page: 40
2026-03-28 07:33:49 [auto1.de] INFO: Found listing with ID: FA82480
2026-03-28 07:33:49 [auto1.de] INFO: Found listing with ID: ZR98160
2026-03-28 07:33:49 [auto1.de] INFO: Found listing with ID: TS72146
2026-03-28 07:33:49 [auto1.de] INFO: Found listing with ID: HY62017
2026-03-28 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY62017%27 HTTP/1.1" 200 None
2026-03-28 07:33:49 [auto1.de] INFO: Scrape type for HY62017: 2
2026-03-28 07:33:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f23eb98b-300c-5bbb-884f-779440bec312 with identifier: HY62017
2026-03-28 07:33:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23eb98b-300c-5bbb-884f-779440bec312 with scrape type 2
2026-03-28 07:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f23eb98b-300c-5bbb-884f-779440bec312 with scrape type 2
2026-03-28 07:33:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f23eb98b-300c-5bbb-884f-779440bec312, identifier: HY62017
2026-03-28 07:33:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f23eb98b-300c-5bbb-884f-779440bec312 with identifier: HY62017
2026-03-28 07:33:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f23eb98b-300c-5bbb-884f-779440bec312 with identifier: HY62017
2026-03-28 07:33:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f23eb98b-300c-5bbb-884f-779440bec312 with identifier: HY62017 to the API
2026-03-28 07:33:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:44:30Z',
'fuel_type': 'diesel',
'id': 'f23eb98b-300c-5bbb-884f-779440bec312',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY62017',
'listing': 'auction',
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 174810,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-15',
'seller_name': None,
'title': 'Renault Grand Scenic 1.7 BLUE dCi BOSE-Edition',
'transmission': 'automatic',
'trim': 'BOSE-Edition',
'year': 2020}
2026-03-28 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY62017%27 HTTP/1.1" 200 None
2026-03-28 07:33:49 [auto1.de] INFO: Saving data for HY62017: {'auction_closing_time': 1774716270.0, 'created_time': 1774467927.996187, 'last_price_update_time': 1774683229.578294}
2026-03-28 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY62017') HTTP/1.1" 204 0
2026-03-28 07:33:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:33:49 [auto1.de] INFO: Found listing with ID: LG80642
2026-03-28 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG80642%27 HTTP/1.1" 200 None
2026-03-28 07:33:49 [auto1.de] INFO: Scrape type for LG80642: 0
2026-03-28 07:33:49 [auto1.de] INFO: Found listing with ID: EC39473
2026-03-28 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC39473%27 HTTP/1.1" 200 None
2026-03-28 07:33:49 [auto1.de] INFO: Scrape type for EC39473: 0
2026-03-28 07:33:49 [auto1.de] INFO: Found listing with ID: NU91903
2026-03-28 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU91903%27 HTTP/1.1" 200 None
2026-03-28 07:33:49 [auto1.de] INFO: Scrape type for NU91903: 0
2026-03-28 07:33:49 [auto1.de] INFO: Found listing with ID: NN85060
2026-03-28 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN85060%27 HTTP/1.1" 200 None
2026-03-28 07:33:49 [auto1.de] INFO: Scrape type for NN85060: 0
2026-03-28 07:33:49 [auto1.de] INFO: Found listing with ID: WG82326
2026-03-28 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG82326%27 HTTP/1.1" 200 None
2026-03-28 07:33:49 [auto1.de] INFO: Scrape type for WG82326: 2
2026-03-28 07:33:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 451229fc-ecf2-5c5c-82b2-67ee0e9e591d with identifier: WG82326
2026-03-28 07:33:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 451229fc-ecf2-5c5c-82b2-67ee0e9e591d with scrape type 2
2026-03-28 07:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 451229fc-ecf2-5c5c-82b2-67ee0e9e591d with scrape type 2
2026-03-28 07:33:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 451229fc-ecf2-5c5c-82b2-67ee0e9e591d, identifier: WG82326
2026-03-28 07:33:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 451229fc-ecf2-5c5c-82b2-67ee0e9e591d with identifier: WG82326
2026-03-28 07:33:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 451229fc-ecf2-5c5c-82b2-67ee0e9e591d with identifier: WG82326
2026-03-28 07:33:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 451229fc-ecf2-5c5c-82b2-67ee0e9e591d with identifier: WG82326 to the API
2026-03-28 07:33:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:52:12Z',
'fuel_type': 'diesel',
'id': '451229fc-ecf2-5c5c-82b2-67ee0e9e591d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG82326',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 258022,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-02',
'seller_name': None,
'title': 'Volkswagen Polo 1.6 TDI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2010}
2026-03-28 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG82326%27 HTTP/1.1" 200 None
2026-03-28 07:33:50 [auto1.de] INFO: Saving data for WG82326: {'auction_closing_time': 1774716732.0, 'created_time': 1774466586.680765, 'last_price_update_time': 1774683230.089848}
2026-03-28 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG82326') HTTP/1.1" 204 0
2026-03-28 07:33:50 [auto1.de] INFO: Found listing with ID: BP78735
2026-03-28 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP78735%27 HTTP/1.1" 200 None
2026-03-28 07:33:50 [auto1.de] INFO: Scrape type for BP78735: 0
2026-03-28 07:33:50 [auto1.de] INFO: Found listing with ID: GL61912
2026-03-28 07:33:50 [auto1.de] INFO: Found listing with ID: SB50854
2026-03-28 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB50854%27 HTTP/1.1" 200 None
2026-03-28 07:33:50 [auto1.de] INFO: Scrape type for SB50854: 0
2026-03-28 07:33:50 [auto1.de] INFO: Found listing with ID: JC70183
2026-03-28 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC70183%27 HTTP/1.1" 200 None
2026-03-28 07:33:50 [auto1.de] INFO: Scrape type for JC70183: 0
2026-03-28 07:33:50 [auto1.de] INFO: Found listing with ID: WS56575
2026-03-28 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS56575%27 HTTP/1.1" 200 None
2026-03-28 07:33:50 [auto1.de] INFO: Scrape type for WS56575: 2
2026-03-28 07:33:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 341b5580-1bd1-50f0-97ff-77ca5d373557 with identifier: WS56575
2026-03-28 07:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 341b5580-1bd1-50f0-97ff-77ca5d373557 with scrape type 2
2026-03-28 07:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 341b5580-1bd1-50f0-97ff-77ca5d373557 with scrape type 2
2026-03-28 07:33:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 341b5580-1bd1-50f0-97ff-77ca5d373557, identifier: WS56575
2026-03-28 07:33:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 341b5580-1bd1-50f0-97ff-77ca5d373557 with identifier: WS56575
2026-03-28 07:33:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 341b5580-1bd1-50f0-97ff-77ca5d373557 with identifier: WS56575
2026-03-28 07:33:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 341b5580-1bd1-50f0-97ff-77ca5d373557 with identifier: WS56575 to the API
2026-03-28 07:33:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:25:03Z',
'fuel_type': 'petrol',
'id': '341b5580-1bd1-50f0-97ff-77ca5d373557',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS56575',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 192667,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-21',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
'transmission': 'automatic',
'trim': 'Comfortline',
'year': 2011}
2026-03-28 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS56575%27 HTTP/1.1" 200 None
2026-03-28 07:33:50 [auto1.de] INFO: Saving data for WS56575: {'auction_closing_time': 1774715103.0, 'created_time': 1774466144.894816, 'last_price_update_time': 1774683230.575658}
2026-03-28 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS56575') HTTP/1.1" 204 0
2026-03-28 07:33:50 [auto1.de] INFO: Found listing with ID: WS31989
2026-03-28 07:33:50 [auto1.de] INFO: Found listing with ID: XT08306
2026-03-28 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT08306%27 HTTP/1.1" 200 None
2026-03-28 07:33:50 [auto1.de] INFO: Scrape type for XT08306: 2
2026-03-28 07:33:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e9e176b-ca79-5d6d-8984-ba3b55625617 with identifier: XT08306
2026-03-28 07:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e9e176b-ca79-5d6d-8984-ba3b55625617 with scrape type 2
2026-03-28 07:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e9e176b-ca79-5d6d-8984-ba3b55625617 with scrape type 2
2026-03-28 07:33:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e9e176b-ca79-5d6d-8984-ba3b55625617, identifier: XT08306
2026-03-28 07:33:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e9e176b-ca79-5d6d-8984-ba3b55625617 with identifier: XT08306
2026-03-28 07:33:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e9e176b-ca79-5d6d-8984-ba3b55625617 with identifier: XT08306
2026-03-28 07:33:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e9e176b-ca79-5d6d-8984-ba3b55625617 with identifier: XT08306 to the API
2026-03-28 07:33:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:08:26Z',
'fuel_type': 'diesel',
'id': '1e9e176b-ca79-5d6d-8984-ba3b55625617',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT08306',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 176653,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-24',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Sync Edition',
'transmission': 'manual',
'trim': 'Sync Edition',
'year': 2016}
2026-03-28 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT08306%27 HTTP/1.1" 200 None
2026-03-28 07:33:51 [auto1.de] INFO: Saving data for XT08306: {'auction_closing_time': 1774714106.0, 'created_time': 1774466865.173607, 'last_price_update_time': 1774683231.093287}
2026-03-28 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT08306') HTTP/1.1" 204 0
2026-03-28 07:33:51 [auto1.de] INFO: Found listing with ID: LS92579
2026-03-28 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS92579%27 HTTP/1.1" 200 None
2026-03-28 07:33:51 [auto1.de] INFO: Scrape type for LS92579: 2
2026-03-28 07:33:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98ccf2a6-0e18-5d37-a03f-389d3b48c5aa with identifier: LS92579
2026-03-28 07:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98ccf2a6-0e18-5d37-a03f-389d3b48c5aa with scrape type 2
2026-03-28 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98ccf2a6-0e18-5d37-a03f-389d3b48c5aa with scrape type 2
2026-03-28 07:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98ccf2a6-0e18-5d37-a03f-389d3b48c5aa, identifier: LS92579
2026-03-28 07:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98ccf2a6-0e18-5d37-a03f-389d3b48c5aa with identifier: LS92579
2026-03-28 07:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98ccf2a6-0e18-5d37-a03f-389d3b48c5aa with identifier: LS92579
2026-03-28 07:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98ccf2a6-0e18-5d37-a03f-389d3b48c5aa with identifier: LS92579 to the API
2026-03-28 07:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:18:54Z',
'fuel_type': 'diesel',
'id': '98ccf2a6-0e18-5d37-a03f-389d3b48c5aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS92579',
'listing': 'auction',
'make': 'Audi',
'model': 'Q2',
'odometer': 184415,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-11',
'seller_name': None,
'title': 'Audi Q2 2.0 TDI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2017}
2026-03-28 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS92579%27 HTTP/1.1" 200 None
2026-03-28 07:33:51 [auto1.de] INFO: Saving data for LS92579: {'auction_closing_time': 1774714734.0, 'created_time': 1774503043.721521, 'last_price_update_time': 1774683231.520762}
2026-03-28 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS92579') HTTP/1.1" 204 0
2026-03-28 07:33:51 [auto1.de] INFO: Found listing with ID: PX47030
2026-03-28 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX47030%27 HTTP/1.1" 200 None
2026-03-28 07:33:51 [auto1.de] INFO: Scrape type for PX47030: 0
2026-03-28 07:33:51 [auto1.de] INFO: Found listing with ID: AD32766
2026-03-28 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD32766%27 HTTP/1.1" 200 None
2026-03-28 07:33:51 [auto1.de] INFO: Scrape type for AD32766: 0
2026-03-28 07:33:51 [auto1.de] INFO: Found listing with ID: RJ41827
2026-03-28 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ41827%27 HTTP/1.1" 200 None
2026-03-28 07:33:51 [auto1.de] INFO: Scrape type for RJ41827: 0
2026-03-28 07:33:51 [auto1.de] INFO: Found listing with ID: XS15243
2026-03-28 07:33:51 [auto1.de] INFO: Found listing with ID: KH60913
2026-03-28 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH60913%27 HTTP/1.1" 200 None
2026-03-28 07:33:51 [auto1.de] INFO: Scrape type for KH60913: 0
2026-03-28 07:33:51 [auto1.de] INFO: Found listing with ID: SD51082
2026-03-28 07:33:51 [auto1.de] INFO: Found listing with ID: RS40485
2026-03-28 07:33:51 [auto1.de] INFO: Found listing with ID: GC08040
2026-03-28 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC08040%27 HTTP/1.1" 200 None
2026-03-28 07:33:51 [auto1.de] INFO: Scrape type for GC08040: 2
2026-03-28 07:33:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 273209cb-02cb-524f-974f-1d1827a5d168 with identifier: GC08040
2026-03-28 07:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 273209cb-02cb-524f-974f-1d1827a5d168 with scrape type 2
2026-03-28 07:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 273209cb-02cb-524f-974f-1d1827a5d168 with scrape type 2
2026-03-28 07:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 273209cb-02cb-524f-974f-1d1827a5d168, identifier: GC08040
2026-03-28 07:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 273209cb-02cb-524f-974f-1d1827a5d168 with identifier: GC08040
2026-03-28 07:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 273209cb-02cb-524f-974f-1d1827a5d168 with identifier: GC08040
2026-03-28 07:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 273209cb-02cb-524f-974f-1d1827a5d168 with identifier: GC08040 to the API
2026-03-28 07:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-28T16:36:49Z',
'fuel_type': 'petrol',
'id': '273209cb-02cb-524f-974f-1d1827a5d168',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC08040',
'listing': 'auction',
'make': 'Kia',
'model': 'Stonic',
'odometer': 51151,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-02',
'seller_name': None,
'title': 'Kia Stonic 1.0 TGDI Vision',
'transmission': 'manual',
'trim': 'Vision',
'year': 2021}
2026-03-28 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC08040%27 HTTP/1.1" 200 None
2026-03-28 07:33:52 [auto1.de] INFO: Saving data for GC08040: {'auction_closing_time': 1774715809.0, 'created_time': 1774465620.062095, 'last_price_update_time': 1774683232.121605}
2026-03-28 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC08040') HTTP/1.1" 204 0
2026-03-28 07:33:52 [auto1.de] INFO: Found listing with ID: ZY60733
2026-03-28 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY60733%27 HTTP/1.1" 200 None
2026-03-28 07:33:52 [auto1.de] INFO: Scrape type for ZY60733: 0
2026-03-28 07:33:52 [auto1.de] INFO: Found listing with ID: VP92353
2026-03-28 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP92353%27 HTTP/1.1" 200 None
2026-03-28 07:33:52 [auto1.de] INFO: Scrape type for VP92353: 0
2026-03-28 07:33:52 [auto1.de] INFO: Found listing with ID: AC60710
2026-03-28 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC60710%27 HTTP/1.1" 200 None
2026-03-28 07:33:52 [auto1.de] INFO: Scrape type for AC60710: 0
2026-03-28 07:33:52 [auto1.de] INFO: Found listing with ID: XU27440
2026-03-28 07:33:52 [auto1.de] INFO: Found listing with ID: ZW69442
2026-03-28 07:33:52 [auto1.de] INFO: Found listing with ID: GG79095
2026-03-28 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG79095%27 HTTP/1.1" 200 None
2026-03-28 07:33:52 [auto1.de] INFO: Scrape type for GG79095: 2
2026-03-28 07:33:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11e49a59-eade-519b-b52b-a111c5fbf199 with identifier: GG79095
2026-03-28 07:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11e49a59-eade-519b-b52b-a111c5fbf199 with scrape type 2
2026-03-28 07:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11e49a59-eade-519b-b52b-a111c5fbf199 with scrape type 2
2026-03-28 07:33:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11e49a59-eade-519b-b52b-a111c5fbf199, identifier: GG79095
2026-03-28 07:33:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11e49a59-eade-519b-b52b-a111c5fbf199 with identifier: GG79095
2026-03-28 07:33:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11e49a59-eade-519b-b52b-a111c5fbf199 with identifier: GG79095
2026-03-28 07:33:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11e49a59-eade-519b-b52b-a111c5fbf199 with identifier: GG79095 to the API
2026-03-28 07:33:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:11:22Z',
'fuel_type': 'petrol',
'id': '11e49a59-eade-519b-b52b-a111c5fbf199',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG79095',
'listing': 'auction',
'make': 'Citroen',
'model': 'DS3 Cabrio',
'odometer': 112088,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-25',
'seller_name': None,
'title': 'Citroen DS3 Cabrio 1.6 VTi SoChic',
'transmission': 'manual',
'trim': 'SoChic',
'year': 2013}
2026-03-28 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG79095%27 HTTP/1.1" 200 None
2026-03-28 07:33:52 [auto1.de] INFO: Saving data for GG79095: {'auction_closing_time': 1774714282.0, 'created_time': 1774466588.365147, 'last_price_update_time': 1774683232.676768}
2026-03-28 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG79095') HTTP/1.1" 204 0
2026-03-28 07:33:52 [auto1.de] INFO: Found listing with ID: ZV46118
2026-03-28 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV46118%27 HTTP/1.1" 200 None
2026-03-28 07:33:52 [auto1.de] INFO: Scrape type for ZV46118: 0
2026-03-28 07:33:52 [auto1.de] INFO: Found listing with ID: VG12821
2026-03-28 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG12821%27 HTTP/1.1" 200 None
2026-03-28 07:33:52 [auto1.de] INFO: Scrape type for VG12821: 0
2026-03-28 07:33:52 [auto1.de] INFO: Found listing with ID: XJ72982
2026-03-28 07:33:52 [auto1.de] INFO: Found listing with ID: LX72474
2026-03-28 07:33:52 [auto1.de] INFO: Found listing with ID: VU02651
2026-03-28 07:33:52 [auto1.de] INFO: Found listing with ID: XB39806
2026-03-28 07:33:52 [auto1.de] INFO: Found listing with ID: DV89701
2026-03-28 07:33:52 [auto1.de] INFO: Found listing with ID: ZS42305
2026-03-28 07:33:52 [auto1.de] INFO: Found listing with ID: NF12246
2026-03-28 07:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:33:53 [auto1.de] INFO: Channel: 24h | Page: 39 | totalHits: 9251 | hits on page: 40
2026-03-28 07:33:53 [auto1.de] INFO: Found listing with ID: RS99660
2026-03-28 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS99660%27 HTTP/1.1" 200 None
2026-03-28 07:33:53 [auto1.de] INFO: Scrape type for RS99660: 2
2026-03-28 07:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81fc760a-31a3-5628-ac4b-43aff98dea00 with identifier: RS99660
2026-03-28 07:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81fc760a-31a3-5628-ac4b-43aff98dea00 with scrape type 2
2026-03-28 07:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81fc760a-31a3-5628-ac4b-43aff98dea00 with scrape type 2
2026-03-28 07:33:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81fc760a-31a3-5628-ac4b-43aff98dea00, identifier: RS99660
2026-03-28 07:33:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81fc760a-31a3-5628-ac4b-43aff98dea00 with identifier: RS99660
2026-03-28 07:33:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81fc760a-31a3-5628-ac4b-43aff98dea00 with identifier: RS99660
2026-03-28 07:33:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81fc760a-31a3-5628-ac4b-43aff98dea00 with identifier: RS99660 to the API
2026-03-28 07:33:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 250,
'expiration_date': '2026-03-28T16:06:44Z',
'fuel_type': 'petrol',
'id': '81fc760a-31a3-5628-ac4b-43aff98dea00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS99660',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 105238,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-03',
'seller_name': None,
'title': 'Ford Focus 2.0 EcoBoost ST',
'transmission': 'manual',
'trim': 'ST',
'year': 2017}
2026-03-28 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS99660%27 HTTP/1.1" 200 None
2026-03-28 07:33:54 [auto1.de] INFO: Saving data for RS99660: {'auction_closing_time': 1774714004.0, 'created_time': 1774464177.067652, 'last_price_update_time': 1774683234.348697}
2026-03-28 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS99660') HTTP/1.1" 204 0
2026-03-28 07:33:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:33:54 [auto1.de] INFO: Found listing with ID: LW97378
2026-03-28 07:33:54 [auto1.de] INFO: Found listing with ID: KP56505
2026-03-28 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP56505%27 HTTP/1.1" 200 None
2026-03-28 07:33:54 [auto1.de] INFO: Scrape type for KP56505: 0
2026-03-28 07:33:54 [auto1.de] INFO: Found listing with ID: BW78905
2026-03-28 07:33:54 [auto1.de] INFO: Found listing with ID: JL26666
2026-03-28 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL26666%27 HTTP/1.1" 200 None
2026-03-28 07:33:54 [auto1.de] INFO: Scrape type for JL26666: 0
2026-03-28 07:33:54 [auto1.de] INFO: Found listing with ID: AL43539
2026-03-28 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL43539%27 HTTP/1.1" 200 None
2026-03-28 07:33:54 [auto1.de] INFO: Scrape type for AL43539: 2
2026-03-28 07:33:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ca93150-59a7-5c9f-a4ef-cc49865afd44 with identifier: AL43539
2026-03-28 07:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ca93150-59a7-5c9f-a4ef-cc49865afd44 with scrape type 2
2026-03-28 07:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ca93150-59a7-5c9f-a4ef-cc49865afd44 with scrape type 2
2026-03-28 07:33:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ca93150-59a7-5c9f-a4ef-cc49865afd44, identifier: AL43539
2026-03-28 07:33:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ca93150-59a7-5c9f-a4ef-cc49865afd44 with identifier: AL43539
2026-03-28 07:33:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ca93150-59a7-5c9f-a4ef-cc49865afd44 with identifier: AL43539
2026-03-28 07:33:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ca93150-59a7-5c9f-a4ef-cc49865afd44 with identifier: AL43539 to the API
2026-03-28 07:33:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:43:54Z',
'fuel_type': 'diesel',
'id': '7ca93150-59a7-5c9f-a4ef-cc49865afd44',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL43539',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 163955,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-23',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2018}
2026-03-28 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL43539%27 HTTP/1.1" 200 None
2026-03-28 07:33:54 [auto1.de] INFO: Saving data for AL43539: {'auction_closing_time': 1774716234.0, 'created_time': 1774466039.6548629, 'last_price_update_time': 1774683234.923517}
2026-03-28 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL43539') HTTP/1.1" 204 0
2026-03-28 07:33:54 [auto1.de] INFO: Found listing with ID: LT28781
2026-03-28 07:33:54 [auto1.de] INFO: Found listing with ID: RW46423
2026-03-28 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW46423%27 HTTP/1.1" 200 None
2026-03-28 07:33:54 [auto1.de] INFO: Scrape type for RW46423: 0
2026-03-28 07:33:54 [auto1.de] INFO: Found listing with ID: VJ57746
2026-03-28 07:33:54 [auto1.de] INFO: Found listing with ID: NP20797
2026-03-28 07:33:54 [auto1.de] INFO: Found listing with ID: VL31529
2026-03-28 07:33:54 [auto1.de] INFO: Found listing with ID: RE78828
2026-03-28 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE78828%27 HTTP/1.1" 200 None
2026-03-28 07:33:54 [auto1.de] INFO: Scrape type for RE78828: 2
2026-03-28 07:33:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee3820c1-6892-519d-bde1-fa0923f3902d with identifier: RE78828
2026-03-28 07:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee3820c1-6892-519d-bde1-fa0923f3902d with scrape type 2
2026-03-28 07:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee3820c1-6892-519d-bde1-fa0923f3902d with scrape type 2
2026-03-28 07:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee3820c1-6892-519d-bde1-fa0923f3902d, identifier: RE78828
2026-03-28 07:33:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee3820c1-6892-519d-bde1-fa0923f3902d with identifier: RE78828
2026-03-28 07:33:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee3820c1-6892-519d-bde1-fa0923f3902d with identifier: RE78828
2026-03-28 07:33:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee3820c1-6892-519d-bde1-fa0923f3902d with identifier: RE78828 to the API
2026-03-28 07:33:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-28T16:09:12Z',
'fuel_type': 'petrol',
'id': 'ee3820c1-6892-519d-bde1-fa0923f3902d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE78828',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 26687,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-11-28',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 T-GDI Mild-Hybrid Prime',
'transmission': 'automatic',
'trim': 'Prime',
'year': 2024}
2026-03-28 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE78828%27 HTTP/1.1" 200 None
2026-03-28 07:33:55 [auto1.de] INFO: Saving data for RE78828: {'auction_closing_time': 1774714152.0, 'created_time': 1774466077.361212, 'last_price_update_time': 1774683235.360295}
2026-03-28 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE78828') HTTP/1.1" 204 0
2026-03-28 07:33:55 [auto1.de] INFO: Found listing with ID: VX80468
2026-03-28 07:33:55 [auto1.de] INFO: Found listing with ID: LF99231
2026-03-28 07:33:55 [auto1.de] INFO: Found listing with ID: FN01227
2026-03-28 07:33:55 [auto1.de] INFO: Found listing with ID: YE53774
2026-03-28 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE53774%27 HTTP/1.1" 200 None
2026-03-28 07:33:55 [auto1.de] INFO: Scrape type for YE53774: 0
2026-03-28 07:33:55 [auto1.de] INFO: Found listing with ID: PP24406
2026-03-28 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP24406%27 HTTP/1.1" 200 None
2026-03-28 07:33:55 [auto1.de] INFO: Scrape type for PP24406: 0
2026-03-28 07:33:55 [auto1.de] INFO: Found listing with ID: YH42279
2026-03-28 07:33:55 [auto1.de] INFO: Found listing with ID: US02373
2026-03-28 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02373%27 HTTP/1.1" 200 None
2026-03-28 07:33:55 [auto1.de] INFO: Scrape type for US02373: 0
2026-03-28 07:33:55 [auto1.de] INFO: Found listing with ID: UP47374
2026-03-28 07:33:55 [auto1.de] INFO: Found listing with ID: PS14610
2026-03-28 07:33:55 [auto1.de] INFO: Found listing with ID: AH65486
2026-03-28 07:33:55 [auto1.de] INFO: Found listing with ID: SL60140
2026-03-28 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL60140%27 HTTP/1.1" 200 None
2026-03-28 07:33:55 [auto1.de] INFO: Scrape type for SL60140: 0
2026-03-28 07:33:55 [auto1.de] INFO: Found listing with ID: RC15993
2026-03-28 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC15993%27 HTTP/1.1" 200 None
2026-03-28 07:33:55 [auto1.de] INFO: Scrape type for RC15993: 0
2026-03-28 07:33:55 [auto1.de] INFO: Found listing with ID: NF90345
2026-03-28 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF90345%27 HTTP/1.1" 200 None
2026-03-28 07:33:55 [auto1.de] INFO: Scrape type for NF90345: 2
2026-03-28 07:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff19d588-d71e-5975-a214-e4b9eb30d320 with identifier: NF90345
2026-03-28 07:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff19d588-d71e-5975-a214-e4b9eb30d320 with scrape type 2
2026-03-28 07:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff19d588-d71e-5975-a214-e4b9eb30d320 with scrape type 2
2026-03-28 07:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff19d588-d71e-5975-a214-e4b9eb30d320, identifier: NF90345
2026-03-28 07:33:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff19d588-d71e-5975-a214-e4b9eb30d320 with identifier: NF90345
2026-03-28 07:33:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff19d588-d71e-5975-a214-e4b9eb30d320 with identifier: NF90345
2026-03-28 07:33:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff19d588-d71e-5975-a214-e4b9eb30d320 with identifier: NF90345 to the API
2026-03-28 07:33:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:19:22Z',
'fuel_type': 'petrol',
'id': 'ff19d588-d71e-5975-a214-e4b9eb30d320',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF90345',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 102546,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-26',
'seller_name': None,
'title': 'Seat Leon 1.4 TSI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2018}
2026-03-28 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF90345%27 HTTP/1.1" 200 None
2026-03-28 07:33:55 [auto1.de] INFO: Saving data for NF90345: {'auction_closing_time': 1774714762.0, 'created_time': 1774466679.534391, 'last_price_update_time': 1774683235.975603}
2026-03-28 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF90345') HTTP/1.1" 204 0
2026-03-28 07:33:56 [auto1.de] INFO: Found listing with ID: AG84988
2026-03-28 07:33:56 [auto1.de] INFO: Found listing with ID: SD48131
2026-03-28 07:33:56 [auto1.de] INFO: Found listing with ID: NR21254
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR21254%27 HTTP/1.1" 200 None
2026-03-28 07:33:56 [auto1.de] INFO: Scrape type for NR21254: 2
2026-03-28 07:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f871df6d-efcf-5030-8270-4e20907a0920 with identifier: NR21254
2026-03-28 07:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f871df6d-efcf-5030-8270-4e20907a0920 with scrape type 2
2026-03-28 07:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f871df6d-efcf-5030-8270-4e20907a0920 with scrape type 2
2026-03-28 07:33:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f871df6d-efcf-5030-8270-4e20907a0920, identifier: NR21254
2026-03-28 07:33:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f871df6d-efcf-5030-8270-4e20907a0920 with identifier: NR21254
2026-03-28 07:33:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f871df6d-efcf-5030-8270-4e20907a0920 with identifier: NR21254
2026-03-28 07:33:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f871df6d-efcf-5030-8270-4e20907a0920 with identifier: NR21254 to the API
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:07:21Z',
'fuel_type': 'petrol',
'id': 'f871df6d-efcf-5030-8270-4e20907a0920',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR21254',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 70916,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-09-29',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 150 Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2005}
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR21254%27 HTTP/1.1" 200 None
2026-03-28 07:33:56 [auto1.de] INFO: Saving data for NR21254: {'auction_closing_time': 1774714041.0, 'created_time': 1774467036.352425, 'last_price_update_time': 1774683236.492683}
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR21254') HTTP/1.1" 204 0
2026-03-28 07:33:56 [auto1.de] INFO: Found listing with ID: GR74650
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR74650%27 HTTP/1.1" 200 None
2026-03-28 07:33:56 [auto1.de] INFO: Scrape type for GR74650: 0
2026-03-28 07:33:56 [auto1.de] INFO: Found listing with ID: SP00408
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP00408%27 HTTP/1.1" 200 None
2026-03-28 07:33:56 [auto1.de] INFO: Scrape type for SP00408: 0
2026-03-28 07:33:56 [auto1.de] INFO: Found listing with ID: SC26693
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC26693%27 HTTP/1.1" 200 None
2026-03-28 07:33:56 [auto1.de] INFO: Scrape type for SC26693: 0
2026-03-28 07:33:56 [auto1.de] INFO: Found listing with ID: VH89235
2026-03-28 07:33:56 [auto1.de] INFO: Found listing with ID: LU81602
2026-03-28 07:33:56 [auto1.de] INFO: Found listing with ID: LN93862
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN93862%27 HTTP/1.1" 200 None
2026-03-28 07:33:56 [auto1.de] INFO: Scrape type for LN93862: 0
2026-03-28 07:33:56 [auto1.de] INFO: Found listing with ID: NR78378
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR78378%27 HTTP/1.1" 200 None
2026-03-28 07:33:56 [auto1.de] INFO: Scrape type for NR78378: 0
2026-03-28 07:33:56 [auto1.de] INFO: Found listing with ID: MR59336
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR59336%27 HTTP/1.1" 200 None
2026-03-28 07:33:56 [auto1.de] INFO: Scrape type for MR59336: 0
2026-03-28 07:33:56 [auto1.de] INFO: Found listing with ID: KT31788
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT31788%27 HTTP/1.1" 200 None
2026-03-28 07:33:56 [auto1.de] INFO: Scrape type for KT31788: 0
2026-03-28 07:33:56 [auto1.de] INFO: Found listing with ID: SX85367
2026-03-28 07:33:56 [auto1.de] INFO: Found listing with ID: PV86472
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV86472%27 HTTP/1.1" 200 None
2026-03-28 07:33:56 [auto1.de] INFO: Scrape type for PV86472: 0
2026-03-28 07:33:56 [auto1.de] INFO: Found listing with ID: GX75432
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX75432%27 HTTP/1.1" 200 None
2026-03-28 07:33:56 [auto1.de] INFO: Scrape type for GX75432: 0
2026-03-28 07:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:33:57 [auto1.de] INFO: Channel: 24h | Page: 40 | totalHits: 9251 | hits on page: 40
2026-03-28 07:33:57 [auto1.de] INFO: Found listing with ID: RM29704
2026-03-28 07:33:57 [auto1.de] INFO: Found listing with ID: DF78416
2026-03-28 07:33:57 [auto1.de] INFO: Found listing with ID: CF74386
2026-03-28 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF74386%27 HTTP/1.1" 200 None
2026-03-28 07:33:57 [auto1.de] INFO: Scrape type for CF74386: 0
2026-03-28 07:33:57 [auto1.de] INFO: Found listing with ID: TU13190
2026-03-28 07:33:57 [auto1.de] INFO: Found listing with ID: ZU61173
2026-03-28 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU61173%27 HTTP/1.1" 200 None
2026-03-28 07:33:57 [auto1.de] INFO: Scrape type for ZU61173: 0
2026-03-28 07:33:57 [auto1.de] INFO: Found listing with ID: NP44902
2026-03-28 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP44902%27 HTTP/1.1" 200 None
2026-03-28 07:33:57 [auto1.de] INFO: Scrape type for NP44902: 0
2026-03-28 07:33:57 [auto1.de] INFO: Found listing with ID: UX06727
2026-03-28 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX06727%27 HTTP/1.1" 200 None
2026-03-28 07:33:57 [auto1.de] INFO: Scrape type for UX06727: 2
2026-03-28 07:33:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a835c85f-9bbe-585a-953d-fed4233ee17f with identifier: UX06727
2026-03-28 07:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a835c85f-9bbe-585a-953d-fed4233ee17f with scrape type 2
2026-03-28 07:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a835c85f-9bbe-585a-953d-fed4233ee17f with scrape type 2
2026-03-28 07:33:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a835c85f-9bbe-585a-953d-fed4233ee17f, identifier: UX06727
2026-03-28 07:33:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a835c85f-9bbe-585a-953d-fed4233ee17f with identifier: UX06727
2026-03-28 07:33:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a835c85f-9bbe-585a-953d-fed4233ee17f with identifier: UX06727
2026-03-28 07:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a835c85f-9bbe-585a-953d-fed4233ee17f with identifier: UX06727 to the API
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:43:21Z',
'fuel_type': 'petrol',
'id': 'a835c85f-9bbe-585a-953d-fed4233ee17f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX06727',
'listing': 'auction',
'make': 'Audi',
'model': 'Q2',
'odometer': 32027,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-28',
'seller_name': None,
'title': 'Audi Q2 35 TFSI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2023}
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX06727%27 HTTP/1.1" 200 None
2026-03-28 07:33:58 [auto1.de] INFO: Saving data for UX06727: {'auction_closing_time': 1774716201.0, 'created_time': 1774466960.431575, 'last_price_update_time': 1774683238.271424}
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX06727') HTTP/1.1" 204 0
2026-03-28 07:33:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:33:58 [auto1.de] INFO: Found listing with ID: UE16674
2026-03-28 07:33:58 [auto1.de] INFO: Found listing with ID: RX78682
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX78682%27 HTTP/1.1" 200 None
2026-03-28 07:33:58 [auto1.de] INFO: Scrape type for RX78682: 0
2026-03-28 07:33:58 [auto1.de] INFO: Found listing with ID: PF21402
2026-03-28 07:33:58 [auto1.de] INFO: Found listing with ID: FJ09626
2026-03-28 07:33:58 [auto1.de] INFO: Found listing with ID: DB02068
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB02068%27 HTTP/1.1" 200 None
2026-03-28 07:33:58 [auto1.de] INFO: Scrape type for DB02068: 0
2026-03-28 07:33:58 [auto1.de] INFO: Found listing with ID: RW82332
2026-03-28 07:33:58 [auto1.de] INFO: Found listing with ID: EU38402
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU38402%27 HTTP/1.1" 200 None
2026-03-28 07:33:58 [auto1.de] INFO: Scrape type for EU38402: 0
2026-03-28 07:33:58 [auto1.de] INFO: Found listing with ID: LV55762
2026-03-28 07:33:58 [auto1.de] INFO: Found listing with ID: DN90837
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN90837%27 HTTP/1.1" 200 None
2026-03-28 07:33:58 [auto1.de] INFO: Scrape type for DN90837: 0
2026-03-28 07:33:58 [auto1.de] INFO: Found listing with ID: DC86459
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC86459%27 HTTP/1.1" 200 None
2026-03-28 07:33:58 [auto1.de] INFO: Scrape type for DC86459: 2
2026-03-28 07:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 703c0d19-2f91-589f-bbea-81a9867f3bed with identifier: DC86459
2026-03-28 07:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 703c0d19-2f91-589f-bbea-81a9867f3bed with scrape type 2
2026-03-28 07:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 703c0d19-2f91-589f-bbea-81a9867f3bed with scrape type 2
2026-03-28 07:33:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 703c0d19-2f91-589f-bbea-81a9867f3bed, identifier: DC86459
2026-03-28 07:33:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 703c0d19-2f91-589f-bbea-81a9867f3bed with identifier: DC86459
2026-03-28 07:33:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 703c0d19-2f91-589f-bbea-81a9867f3bed with identifier: DC86459
2026-03-28 07:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 703c0d19-2f91-589f-bbea-81a9867f3bed with identifier: DC86459 to the API
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 197,
'expiration_date': '2026-03-28T16:49:31Z',
'fuel_type': 'diesel',
'id': '703c0d19-2f91-589f-bbea-81a9867f3bed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC86459',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 55557,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-21',
'seller_name': None,
'title': 'Volvo XC60 2.0 B4 Mild-Hybrid Momentum Pro 2WD',
'transmission': 'automatic',
'trim': 'Momentum Pro 2WD',
'year': 2021}
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC86459%27 HTTP/1.1" 200 None
2026-03-28 07:33:58 [auto1.de] INFO: Saving data for DC86459: {'auction_closing_time': 1774716571.0, 'created_time': 1773830095.084238, 'last_price_update_time': 1774683238.925545}
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC86459') HTTP/1.1" 204 0
2026-03-28 07:33:58 [auto1.de] INFO: Found listing with ID: UW48203
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW48203%27 HTTP/1.1" 200 None
2026-03-28 07:33:58 [auto1.de] INFO: Scrape type for UW48203: 0
2026-03-28 07:33:58 [auto1.de] INFO: Found listing with ID: GX87234
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX87234%27 HTTP/1.1" 200 None
2026-03-28 07:33:58 [auto1.de] INFO: Scrape type for GX87234: 0
2026-03-28 07:33:58 [auto1.de] INFO: Found listing with ID: FD35505
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD35505%27 HTTP/1.1" 200 None
2026-03-28 07:33:58 [auto1.de] INFO: Scrape type for FD35505: 2
2026-03-28 07:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cffc09ee-41dd-591c-8406-4c341567bd5b with identifier: FD35505
2026-03-28 07:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cffc09ee-41dd-591c-8406-4c341567bd5b with scrape type 2
2026-03-28 07:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cffc09ee-41dd-591c-8406-4c341567bd5b with scrape type 2
2026-03-28 07:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cffc09ee-41dd-591c-8406-4c341567bd5b, identifier: FD35505
2026-03-28 07:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cffc09ee-41dd-591c-8406-4c341567bd5b with identifier: FD35505
2026-03-28 07:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cffc09ee-41dd-591c-8406-4c341567bd5b with identifier: FD35505
2026-03-28 07:33:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cffc09ee-41dd-591c-8406-4c341567bd5b with identifier: FD35505 to the API
2026-03-28 07:33:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:33:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-28T16:38:20Z',
'fuel_type': 'petrol',
'id': 'cffc09ee-41dd-591c-8406-4c341567bd5b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD35505',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 191034,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-12-18',
'seller_name': None,
'title': 'Audi A4 1.8 TFSI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2008}
2026-03-28 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD35505%27 HTTP/1.1" 200 None
2026-03-28 07:33:59 [auto1.de] INFO: Saving data for FD35505: {'auction_closing_time': 1774715900.0, 'created_time': 1773829873.829179, 'last_price_update_time': 1774683239.395511}
2026-03-28 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD35505') HTTP/1.1" 204 0
2026-03-28 07:33:59 [auto1.de] INFO: Found listing with ID: LK34875
2026-03-28 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK34875%27 HTTP/1.1" 200 None
2026-03-28 07:33:59 [auto1.de] INFO: Scrape type for LK34875: 0
2026-03-28 07:33:59 [auto1.de] INFO: Found listing with ID: LW85167
2026-03-28 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW85167%27 HTTP/1.1" 200 None
2026-03-28 07:33:59 [auto1.de] INFO: Scrape type for LW85167: 0
2026-03-28 07:33:59 [auto1.de] INFO: Found listing with ID: YA77478
2026-03-28 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA77478%27 HTTP/1.1" 200 None
2026-03-28 07:33:59 [auto1.de] INFO: Scrape type for YA77478: 0
2026-03-28 07:33:59 [auto1.de] INFO: Found listing with ID: VK80269
2026-03-28 07:33:59 [auto1.de] INFO: Found listing with ID: HW43883
2026-03-28 07:33:59 [auto1.de] INFO: Found listing with ID: WY19584
2026-03-28 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY19584%27 HTTP/1.1" 200 None
2026-03-28 07:33:59 [auto1.de] INFO: Scrape type for WY19584: 0
2026-03-28 07:33:59 [auto1.de] INFO: Found listing with ID: JX06129
2026-03-28 07:33:59 [auto1.de] INFO: Found listing with ID: CF23775
2026-03-28 07:33:59 [auto1.de] INFO: Found listing with ID: AC62471
2026-03-28 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC62471%27 HTTP/1.1" 200 None
2026-03-28 07:33:59 [auto1.de] INFO: Scrape type for AC62471: 0
2026-03-28 07:33:59 [auto1.de] INFO: Found listing with ID: LJ59261
2026-03-28 07:33:59 [auto1.de] INFO: Found listing with ID: EE77460
2026-03-28 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE77460%27 HTTP/1.1" 200 None
2026-03-28 07:33:59 [auto1.de] INFO: Scrape type for EE77460: 0
2026-03-28 07:33:59 [auto1.de] INFO: Found listing with ID: HR49435
2026-03-28 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR49435%27 HTTP/1.1" 200 None
2026-03-28 07:33:59 [auto1.de] INFO: Scrape type for HR49435: 2
2026-03-28 07:33:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59795e83-2ed9-550a-af78-5b87e4a2e886 with identifier: HR49435
2026-03-28 07:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59795e83-2ed9-550a-af78-5b87e4a2e886 with scrape type 2
2026-03-28 07:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59795e83-2ed9-550a-af78-5b87e4a2e886 with scrape type 2
2026-03-28 07:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 59795e83-2ed9-550a-af78-5b87e4a2e886, identifier: HR49435
2026-03-28 07:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 59795e83-2ed9-550a-af78-5b87e4a2e886 with identifier: HR49435
2026-03-28 07:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 59795e83-2ed9-550a-af78-5b87e4a2e886 with identifier: HR49435
2026-03-28 07:33:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 59795e83-2ed9-550a-af78-5b87e4a2e886 with identifier: HR49435 to the API
2026-03-28 07:33:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:33:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:10:10Z',
'fuel_type': 'diesel',
'id': '59795e83-2ed9-550a-af78-5b87e4a2e886',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR49435',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 204462,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-28',
'seller_name': None,
'title': 'Peugeot 3008 2.0 HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2014}
2026-03-28 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR49435%27 HTTP/1.1" 200 None
2026-03-28 07:34:00 [auto1.de] INFO: Saving data for HR49435: {'auction_closing_time': 1774714210.0, 'created_time': 1774071035.177323, 'last_price_update_time': 1774683240.060083}
2026-03-28 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR49435') HTTP/1.1" 204 0
2026-03-28 07:34:00 [auto1.de] INFO: Found listing with ID: LM30127
2026-03-28 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM30127%27 HTTP/1.1" 200 None
2026-03-28 07:34:00 [auto1.de] INFO: Scrape type for LM30127: 0
2026-03-28 07:34:00 [auto1.de] INFO: Found listing with ID: EM14245
2026-03-28 07:34:00 [auto1.de] INFO: Found listing with ID: HW30650
2026-03-28 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW30650%27 HTTP/1.1" 200 None
2026-03-28 07:34:00 [auto1.de] INFO: Scrape type for HW30650: 0
2026-03-28 07:34:00 [auto1.de] INFO: Found listing with ID: NF21329
2026-03-28 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF21329%27 HTTP/1.1" 200 None
2026-03-28 07:34:00 [auto1.de] INFO: Scrape type for NF21329: 2
2026-03-28 07:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b08c9c2d-acd2-5c7c-bad2-c12a88985209 with identifier: NF21329
2026-03-28 07:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b08c9c2d-acd2-5c7c-bad2-c12a88985209 with scrape type 2
2026-03-28 07:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b08c9c2d-acd2-5c7c-bad2-c12a88985209 with scrape type 2
2026-03-28 07:34:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b08c9c2d-acd2-5c7c-bad2-c12a88985209, identifier: NF21329
2026-03-28 07:34:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b08c9c2d-acd2-5c7c-bad2-c12a88985209 with identifier: NF21329
2026-03-28 07:34:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b08c9c2d-acd2-5c7c-bad2-c12a88985209 with identifier: NF21329
2026-03-28 07:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b08c9c2d-acd2-5c7c-bad2-c12a88985209 with identifier: NF21329 to the API
2026-03-28 07:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:45:14Z',
'fuel_type': 'diesel',
'id': 'b08c9c2d-acd2-5c7c-bad2-c12a88985209',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF21329',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 282604,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-10-29',
'seller_name': None,
'title': 'Volkswagen Caddy 1.9 TDI Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2006}
2026-03-28 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF21329%27 HTTP/1.1" 200 None
2026-03-28 07:34:00 [auto1.de] INFO: Saving data for NF21329: {'auction_closing_time': 1774716314.0, 'created_time': 1774468023.418715, 'last_price_update_time': 1774683240.639446}
2026-03-28 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF21329') HTTP/1.1" 204 0
2026-03-28 07:34:00 [auto1.de] INFO: Found listing with ID: ZJ77365
2026-03-28 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ77365%27 HTTP/1.1" 200 None
2026-03-28 07:34:00 [auto1.de] INFO: Scrape type for ZJ77365: 0
2026-03-28 07:34:00 [auto1.de] INFO: Found listing with ID: GB55666
2026-03-28 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB55666%27 HTTP/1.1" 200 None
2026-03-28 07:34:00 [auto1.de] INFO: Scrape type for GB55666: 2
2026-03-28 07:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1b32f18-6d7f-5bb2-9885-7a18b37e1bd9 with identifier: GB55666
2026-03-28 07:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1b32f18-6d7f-5bb2-9885-7a18b37e1bd9 with scrape type 2
2026-03-28 07:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1b32f18-6d7f-5bb2-9885-7a18b37e1bd9 with scrape type 2
2026-03-28 07:34:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1b32f18-6d7f-5bb2-9885-7a18b37e1bd9, identifier: GB55666
2026-03-28 07:34:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1b32f18-6d7f-5bb2-9885-7a18b37e1bd9 with identifier: GB55666
2026-03-28 07:34:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1b32f18-6d7f-5bb2-9885-7a18b37e1bd9 with identifier: GB55666
2026-03-28 07:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1b32f18-6d7f-5bb2-9885-7a18b37e1bd9 with identifier: GB55666 to the API
2026-03-28 07:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:57:23Z',
'fuel_type': 'petrol',
'id': 'c1b32f18-6d7f-5bb2-9885-7a18b37e1bd9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB55666',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 113488,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-21',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2011}
2026-03-28 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB55666%27 HTTP/1.1" 200 None
2026-03-28 07:34:01 [auto1.de] INFO: Saving data for GB55666: {'auction_closing_time': 1774717043.0, 'created_time': 1773859660.924358, 'last_price_update_time': 1774683241.094283}
2026-03-28 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB55666') HTTP/1.1" 204 0
2026-03-28 07:34:01 [auto1.de] INFO: Found listing with ID: XT00440
2026-03-28 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT00440%27 HTTP/1.1" 200 None
2026-03-28 07:34:01 [auto1.de] INFO: Scrape type for XT00440: 0
2026-03-28 07:34:01 [auto1.de] INFO: Found listing with ID: UY21095
2026-03-28 07:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:34:01 [auto1.de] INFO: Channel: 24h | Page: 41 | totalHits: 9251 | hits on page: 40
2026-03-28 07:34:01 [auto1.de] INFO: Found listing with ID: UK10359
2026-03-28 07:34:01 [auto1.de] INFO: Found listing with ID: MS75707
2026-03-28 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS75707%27 HTTP/1.1" 200 None
2026-03-28 07:34:01 [auto1.de] INFO: Scrape type for MS75707: 0
2026-03-28 07:34:01 [auto1.de] INFO: Found listing with ID: NY96268
2026-03-28 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY96268%27 HTTP/1.1" 200 None
2026-03-28 07:34:01 [auto1.de] INFO: Scrape type for NY96268: 0
2026-03-28 07:34:01 [auto1.de] INFO: Found listing with ID: HX46872
2026-03-28 07:34:01 [auto1.de] INFO: Found listing with ID: DE17947
2026-03-28 07:34:01 [auto1.de] INFO: Found listing with ID: YC50370
2026-03-28 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC50370%27 HTTP/1.1" 200 None
2026-03-28 07:34:01 [auto1.de] INFO: Scrape type for YC50370: 0
2026-03-28 07:34:01 [auto1.de] INFO: Found listing with ID: XN65057
2026-03-28 07:34:01 [auto1.de] INFO: Found listing with ID: XS21978
2026-03-28 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS21978%27 HTTP/1.1" 200 None
2026-03-28 07:34:01 [auto1.de] INFO: Scrape type for XS21978: 0
2026-03-28 07:34:01 [auto1.de] INFO: Found listing with ID: VM56295
2026-03-28 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM56295%27 HTTP/1.1" 200 None
2026-03-28 07:34:01 [auto1.de] INFO: Scrape type for VM56295: 2
2026-03-28 07:34:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 276390ea-56ee-52b5-98d8-c7a925b17366 with identifier: VM56295
2026-03-28 07:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 276390ea-56ee-52b5-98d8-c7a925b17366 with scrape type 2
2026-03-28 07:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 276390ea-56ee-52b5-98d8-c7a925b17366 with scrape type 2
2026-03-28 07:34:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 276390ea-56ee-52b5-98d8-c7a925b17366, identifier: VM56295
2026-03-28 07:34:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 276390ea-56ee-52b5-98d8-c7a925b17366 with identifier: VM56295
2026-03-28 07:34:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 276390ea-56ee-52b5-98d8-c7a925b17366 with identifier: VM56295
2026-03-28 07:34:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 276390ea-56ee-52b5-98d8-c7a925b17366 with identifier: VM56295 to the API
2026-03-28 07:34:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:18:56Z',
'fuel_type': 'diesel',
'id': '276390ea-56ee-52b5-98d8-c7a925b17366',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM56295',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 198956,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-17',
'seller_name': None,
'title': 'Volkswagen Touran 1.9 TDI United',
'transmission': 'manual',
'trim': 'United',
'year': 2009}
2026-03-28 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM56295%27 HTTP/1.1" 200 None
2026-03-28 07:34:02 [auto1.de] INFO: Saving data for VM56295: {'auction_closing_time': 1774714736.0, 'created_time': 1774503044.859993, 'last_price_update_time': 1774683242.050091}
2026-03-28 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VM56295') HTTP/1.1" 204 0
2026-03-28 07:34:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:34:02 [auto1.de] INFO: Found listing with ID: RR66654
2026-03-28 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR66654%27 HTTP/1.1" 200 None
2026-03-28 07:34:02 [auto1.de] INFO: Scrape type for RR66654: 0
2026-03-28 07:34:02 [auto1.de] INFO: Found listing with ID: RW07323
2026-03-28 07:34:02 [auto1.de] INFO: Found listing with ID: JR00588
2026-03-28 07:34:02 [auto1.de] INFO: Found listing with ID: AE93304
2026-03-28 07:34:02 [auto1.de] INFO: Found listing with ID: KD53590
2026-03-28 07:34:02 [auto1.de] INFO: Found listing with ID: PM54102
2026-03-28 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM54102%27 HTTP/1.1" 200 None
2026-03-28 07:34:02 [auto1.de] INFO: Scrape type for PM54102: 2
2026-03-28 07:34:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32951362-b034-5d89-b12d-042330c687ba with identifier: PM54102
2026-03-28 07:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32951362-b034-5d89-b12d-042330c687ba with scrape type 2
2026-03-28 07:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32951362-b034-5d89-b12d-042330c687ba with scrape type 2
2026-03-28 07:34:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32951362-b034-5d89-b12d-042330c687ba, identifier: PM54102
2026-03-28 07:34:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32951362-b034-5d89-b12d-042330c687ba with identifier: PM54102
2026-03-28 07:34:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32951362-b034-5d89-b12d-042330c687ba with identifier: PM54102
2026-03-28 07:34:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32951362-b034-5d89-b12d-042330c687ba with identifier: PM54102 to the API
2026-03-28 07:34:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:23:09Z',
'fuel_type': 'petrol',
'id': '32951362-b034-5d89-b12d-042330c687ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM54102',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 203995,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-06',
'seller_name': None,
'title': 'Skoda Octavia 1.2 TSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2013}
2026-03-28 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM54102%27 HTTP/1.1" 200 None
2026-03-28 07:34:02 [auto1.de] INFO: Saving data for PM54102: {'auction_closing_time': 1774714989.0, 'created_time': 1774465888.087117, 'last_price_update_time': 1774683242.609252}
2026-03-28 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PM54102') HTTP/1.1" 204 0
2026-03-28 07:34:02 [auto1.de] INFO: Found listing with ID: ZJ39351
2026-03-28 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ39351%27 HTTP/1.1" 200 None
2026-03-28 07:34:02 [auto1.de] INFO: Scrape type for ZJ39351: 0
2026-03-28 07:34:02 [auto1.de] INFO: Found listing with ID: YR25980
2026-03-28 07:34:02 [auto1.de] INFO: Found listing with ID: VT43931
2026-03-28 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT43931%27 HTTP/1.1" 200 None
2026-03-28 07:34:02 [auto1.de] INFO: Scrape type for VT43931: 0
2026-03-28 07:34:02 [auto1.de] INFO: Found listing with ID: DS40784
2026-03-28 07:34:02 [auto1.de] INFO: Found listing with ID: GE94573
2026-03-28 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE94573%27 HTTP/1.1" 200 None
2026-03-28 07:34:02 [auto1.de] INFO: Scrape type for GE94573: 2
2026-03-28 07:34:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3642deb4-38e0-5577-8aa3-207c0df26f83 with identifier: GE94573
2026-03-28 07:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3642deb4-38e0-5577-8aa3-207c0df26f83 with scrape type 2
2026-03-28 07:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3642deb4-38e0-5577-8aa3-207c0df26f83 with scrape type 2
2026-03-28 07:34:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3642deb4-38e0-5577-8aa3-207c0df26f83, identifier: GE94573
2026-03-28 07:34:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3642deb4-38e0-5577-8aa3-207c0df26f83 with identifier: GE94573
2026-03-28 07:34:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3642deb4-38e0-5577-8aa3-207c0df26f83 with identifier: GE94573
2026-03-28 07:34:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3642deb4-38e0-5577-8aa3-207c0df26f83 with identifier: GE94573 to the API
2026-03-28 07:34:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:08:05Z',
'fuel_type': 'petrol',
'id': '3642deb4-38e0-5577-8aa3-207c0df26f83',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE94573',
'listing': 'auction',
'make': 'Mazda',
'model': 'Tribute',
'odometer': 171513,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-05-22',
'seller_name': None,
'title': 'Mazda Tribute 2.0 Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2002}
2026-03-28 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE94573%27 HTTP/1.1" 200 None
2026-03-28 07:34:03 [auto1.de] INFO: Saving data for GE94573: {'auction_closing_time': 1774714085.0, 'created_time': 1774467151.276684, 'last_price_update_time': 1774683243.06511}
2026-03-28 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE94573') HTTP/1.1" 204 0
2026-03-28 07:34:03 [auto1.de] INFO: Found listing with ID: KJ26847
2026-03-28 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ26847%27 HTTP/1.1" 200 None
2026-03-28 07:34:03 [auto1.de] INFO: Scrape type for KJ26847: 0
2026-03-28 07:34:03 [auto1.de] INFO: Found listing with ID: AN17735
2026-03-28 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN17735%27 HTTP/1.1" 200 None
2026-03-28 07:34:03 [auto1.de] INFO: Scrape type for AN17735: 0
2026-03-28 07:34:03 [auto1.de] INFO: Found listing with ID: NE28687
2026-03-28 07:34:03 [auto1.de] INFO: Found listing with ID: JT80939
2026-03-28 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT80939%27 HTTP/1.1" 200 None
2026-03-28 07:34:03 [auto1.de] INFO: Scrape type for JT80939: 0
2026-03-28 07:34:03 [auto1.de] INFO: Found listing with ID: CZ44674
2026-03-28 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ44674%27 HTTP/1.1" 200 None
2026-03-28 07:34:03 [auto1.de] INFO: Scrape type for CZ44674: 0
2026-03-28 07:34:03 [auto1.de] INFO: Found listing with ID: KU48054
2026-03-28 07:34:03 [auto1.de] INFO: Found listing with ID: DM27064
2026-03-28 07:34:03 [auto1.de] INFO: Found listing with ID: AK06166
2026-03-28 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK06166%27 HTTP/1.1" 200 None
2026-03-28 07:34:03 [auto1.de] INFO: Scrape type for AK06166: 2
2026-03-28 07:34:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8250694-a85e-5eb6-8b55-9e6b4d254845 with identifier: AK06166
2026-03-28 07:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8250694-a85e-5eb6-8b55-9e6b4d254845 with scrape type 2
2026-03-28 07:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8250694-a85e-5eb6-8b55-9e6b4d254845 with scrape type 2
2026-03-28 07:34:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8250694-a85e-5eb6-8b55-9e6b4d254845, identifier: AK06166
2026-03-28 07:34:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8250694-a85e-5eb6-8b55-9e6b4d254845 with identifier: AK06166
2026-03-28 07:34:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8250694-a85e-5eb6-8b55-9e6b4d254845 with identifier: AK06166
2026-03-28 07:34:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8250694-a85e-5eb6-8b55-9e6b4d254845 with identifier: AK06166 to the API
2026-03-28 07:34:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-28T16:02:19Z',
'fuel_type': 'petrol',
'id': 'a8250694-a85e-5eb6-8b55-9e6b4d254845',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK06166',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Lancer',
'odometer': 96715,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-28',
'seller_name': None,
'title': 'Mitsubishi Lancer 1.8 DOHC Instyle',
'transmission': 'automatic',
'trim': 'Instyle',
'year': 2009}
2026-03-28 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK06166%27 HTTP/1.1" 200 None
2026-03-28 07:34:03 [auto1.de] INFO: Saving data for AK06166: {'auction_closing_time': 1774713739.0, 'created_time': 1774468140.132813, 'last_price_update_time': 1774683243.648936}
2026-03-28 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK06166') HTTP/1.1" 204 0
2026-03-28 07:34:03 [auto1.de] INFO: Found listing with ID: RD74576
2026-03-28 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD74576%27 HTTP/1.1" 200 None
2026-03-28 07:34:03 [auto1.de] INFO: Scrape type for RD74576: 2
2026-03-28 07:34:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a024e87-62c7-532c-b5c0-38df268b68ec with identifier: RD74576
2026-03-28 07:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a024e87-62c7-532c-b5c0-38df268b68ec with scrape type 2
2026-03-28 07:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a024e87-62c7-532c-b5c0-38df268b68ec with scrape type 2
2026-03-28 07:34:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a024e87-62c7-532c-b5c0-38df268b68ec, identifier: RD74576
2026-03-28 07:34:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a024e87-62c7-532c-b5c0-38df268b68ec with identifier: RD74576
2026-03-28 07:34:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a024e87-62c7-532c-b5c0-38df268b68ec with identifier: RD74576
2026-03-28 07:34:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a024e87-62c7-532c-b5c0-38df268b68ec with identifier: RD74576 to the API
2026-03-28 07:34:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 275,
'expiration_date': '2026-03-28T16:39:49Z',
'fuel_type': 'petrol',
'id': '6a024e87-62c7-532c-b5c0-38df268b68ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD74576',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 83676,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-15',
'seller_name': None,
'title': 'Hyundai i30 2.0 TGDI N Performance',
'transmission': 'manual',
'trim': 'N Performance',
'year': 2019}
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD74576%27 HTTP/1.1" 200 None
2026-03-28 07:34:04 [auto1.de] INFO: Saving data for RD74576: {'auction_closing_time': 1774715989.0, 'created_time': 1774467291.201434, 'last_price_update_time': 1774683244.077818}
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD74576') HTTP/1.1" 204 0
2026-03-28 07:34:04 [auto1.de] INFO: Found listing with ID: KN88175
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN88175%27 HTTP/1.1" 200 None
2026-03-28 07:34:04 [auto1.de] INFO: Scrape type for KN88175: 0
2026-03-28 07:34:04 [auto1.de] INFO: Found listing with ID: MV92075
2026-03-28 07:34:04 [auto1.de] INFO: Found listing with ID: RG01801
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG01801%27 HTTP/1.1" 200 None
2026-03-28 07:34:04 [auto1.de] INFO: Scrape type for RG01801: 0
2026-03-28 07:34:04 [auto1.de] INFO: Found listing with ID: LC82989
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC82989%27 HTTP/1.1" 200 None
2026-03-28 07:34:04 [auto1.de] INFO: Scrape type for LC82989: 0
2026-03-28 07:34:04 [auto1.de] INFO: Found listing with ID: DL83760
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL83760%27 HTTP/1.1" 200 None
2026-03-28 07:34:04 [auto1.de] INFO: Scrape type for DL83760: 0
2026-03-28 07:34:04 [auto1.de] INFO: Found listing with ID: AG08443
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG08443%27 HTTP/1.1" 200 None
2026-03-28 07:34:04 [auto1.de] INFO: Scrape type for AG08443: 0
2026-03-28 07:34:04 [auto1.de] INFO: Found listing with ID: VK16260
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK16260%27 HTTP/1.1" 200 None
2026-03-28 07:34:04 [auto1.de] INFO: Scrape type for VK16260: 0
2026-03-28 07:34:04 [auto1.de] INFO: Found listing with ID: NT22490
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT22490%27 HTTP/1.1" 200 None
2026-03-28 07:34:04 [auto1.de] INFO: Scrape type for NT22490: 0
2026-03-28 07:34:04 [auto1.de] INFO: Found listing with ID: ZX04970
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX04970%27 HTTP/1.1" 200 None
2026-03-28 07:34:04 [auto1.de] INFO: Scrape type for ZX04970: 2
2026-03-28 07:34:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bcffbf6-3270-5199-a402-0d633662af8a with identifier: ZX04970
2026-03-28 07:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bcffbf6-3270-5199-a402-0d633662af8a with scrape type 2
2026-03-28 07:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bcffbf6-3270-5199-a402-0d633662af8a with scrape type 2
2026-03-28 07:34:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1bcffbf6-3270-5199-a402-0d633662af8a, identifier: ZX04970
2026-03-28 07:34:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1bcffbf6-3270-5199-a402-0d633662af8a with identifier: ZX04970
2026-03-28 07:34:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1bcffbf6-3270-5199-a402-0d633662af8a with identifier: ZX04970
2026-03-28 07:34:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1bcffbf6-3270-5199-a402-0d633662af8a with identifier: ZX04970 to the API
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:08:13Z',
'fuel_type': 'petrol',
'id': '1bcffbf6-3270-5199-a402-0d633662af8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX04970',
'listing': 'auction',
'make': 'Ford',
'model': 'B-Max',
'odometer': 164981,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-31',
'seller_name': None,
'title': 'Ford B-Max 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2014}
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX04970%27 HTTP/1.1" 200 None
2026-03-28 07:34:04 [auto1.de] INFO: Saving data for ZX04970: {'auction_closing_time': 1774714093.0, 'created_time': 1774463804.561114, 'last_price_update_time': 1774683244.663171}
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX04970') HTTP/1.1" 204 0
2026-03-28 07:34:04 [auto1.de] INFO: Found listing with ID: KN35431
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN35431%27 HTTP/1.1" 200 None
2026-03-28 07:34:04 [auto1.de] INFO: Scrape type for KN35431: 0
2026-03-28 07:34:04 [auto1.de] INFO: Found listing with ID: JM96313
2026-03-28 07:34:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:34:05 [auto1.de] INFO: Channel: 24h | Page: 42 | totalHits: 9251 | hits on page: 40
2026-03-28 07:34:05 [auto1.de] INFO: Found listing with ID: UX25395
2026-03-28 07:34:05 [auto1.de] INFO: Found listing with ID: EM69554
2026-03-28 07:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM69554%27 HTTP/1.1" 200 None
2026-03-28 07:34:05 [auto1.de] INFO: Scrape type for EM69554: 0
2026-03-28 07:34:05 [auto1.de] INFO: Found listing with ID: AS81057
2026-03-28 07:34:05 [auto1.de] INFO: Found listing with ID: XA15787
2026-03-28 07:34:05 [auto1.de] INFO: Found listing with ID: DL24086
2026-03-28 07:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL24086%27 HTTP/1.1" 200 None
2026-03-28 07:34:05 [auto1.de] INFO: Scrape type for DL24086: 2
2026-03-28 07:34:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9de47d2b-a367-545d-8ff9-5f2480fdae50 with identifier: DL24086
2026-03-28 07:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9de47d2b-a367-545d-8ff9-5f2480fdae50 with scrape type 2
2026-03-28 07:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9de47d2b-a367-545d-8ff9-5f2480fdae50 with scrape type 2
2026-03-28 07:34:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9de47d2b-a367-545d-8ff9-5f2480fdae50, identifier: DL24086
2026-03-28 07:34:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9de47d2b-a367-545d-8ff9-5f2480fdae50 with identifier: DL24086
2026-03-28 07:34:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9de47d2b-a367-545d-8ff9-5f2480fdae50 with identifier: DL24086
2026-03-28 07:34:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9de47d2b-a367-545d-8ff9-5f2480fdae50 with identifier: DL24086 to the API
2026-03-28 07:34:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:54:04Z',
'fuel_type': 'diesel',
'id': '9de47d2b-a367-545d-8ff9-5f2480fdae50',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL24086',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 189253,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-15',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI RS',
'transmission': 'automatic',
'trim': 'RS',
'year': 2015}
2026-03-28 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL24086%27 HTTP/1.1" 200 None
2026-03-28 07:34:06 [auto1.de] INFO: Saving data for DL24086: {'auction_closing_time': 1774716844.0, 'created_time': 1774466408.942032, 'last_price_update_time': 1774683246.190664}
2026-03-28 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL24086') HTTP/1.1" 204 0
2026-03-28 07:34:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:34:06 [auto1.de] INFO: Found listing with ID: LS75828
2026-03-28 07:34:06 [auto1.de] INFO: Found listing with ID: NX05955
2026-03-28 07:34:06 [auto1.de] INFO: Found listing with ID: PJ28903
2026-03-28 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ28903%27 HTTP/1.1" 200 None
2026-03-28 07:34:06 [auto1.de] INFO: Scrape type for PJ28903: 2
2026-03-28 07:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dca02e9f-bdc4-5867-af3d-ecc071a5451d with identifier: PJ28903
2026-03-28 07:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dca02e9f-bdc4-5867-af3d-ecc071a5451d with scrape type 2
2026-03-28 07:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dca02e9f-bdc4-5867-af3d-ecc071a5451d with scrape type 2
2026-03-28 07:34:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dca02e9f-bdc4-5867-af3d-ecc071a5451d, identifier: PJ28903
2026-03-28 07:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dca02e9f-bdc4-5867-af3d-ecc071a5451d with identifier: PJ28903
2026-03-28 07:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dca02e9f-bdc4-5867-af3d-ecc071a5451d with identifier: PJ28903
2026-03-28 07:34:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dca02e9f-bdc4-5867-af3d-ecc071a5451d with identifier: PJ28903 to the API
2026-03-28 07:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:24:26Z',
'fuel_type': 'petrol',
'id': 'dca02e9f-bdc4-5867-af3d-ecc071a5451d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ28903',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 98004,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-05',
'seller_name': None,
'title': 'Volkswagen Touran 1.8 TSI Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2018}
2026-03-28 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ28903%27 HTTP/1.1" 200 None
2026-03-28 07:34:06 [auto1.de] INFO: Saving data for PJ28903: {'auction_closing_time': 1774715066.0, 'created_time': 1774463714.266663, 'last_price_update_time': 1774683246.607881}
2026-03-28 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ28903') HTTP/1.1" 204 0
2026-03-28 07:34:06 [auto1.de] INFO: Found listing with ID: VJ43142
2026-03-28 07:34:06 [auto1.de] INFO: Found listing with ID: KN21474
2026-03-28 07:34:06 [auto1.de] INFO: Found listing with ID: ZL05657
2026-03-28 07:34:06 [auto1.de] INFO: Found listing with ID: BX19940
2026-03-28 07:34:06 [auto1.de] INFO: Found listing with ID: MA14721
2026-03-28 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA14721%27 HTTP/1.1" 200 None
2026-03-28 07:34:06 [auto1.de] INFO: Scrape type for MA14721: 0
2026-03-28 07:34:06 [auto1.de] INFO: Found listing with ID: MK93259
2026-03-28 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK93259%27 HTTP/1.1" 200 None
2026-03-28 07:34:06 [auto1.de] INFO: Scrape type for MK93259: 0
2026-03-28 07:34:06 [auto1.de] INFO: Found listing with ID: YH51203
2026-03-28 07:34:06 [auto1.de] INFO: Found listing with ID: VR19710
2026-03-28 07:34:06 [auto1.de] INFO: Found listing with ID: XJ13626
2026-03-28 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ13626%27 HTTP/1.1" 200 None
2026-03-28 07:34:06 [auto1.de] INFO: Scrape type for XJ13626: 2
2026-03-28 07:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8380df58-c81c-5787-b1d5-448b833904cc with identifier: XJ13626
2026-03-28 07:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8380df58-c81c-5787-b1d5-448b833904cc with scrape type 2
2026-03-28 07:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8380df58-c81c-5787-b1d5-448b833904cc with scrape type 2
2026-03-28 07:34:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8380df58-c81c-5787-b1d5-448b833904cc, identifier: XJ13626
2026-03-28 07:34:06 [scrapy.extensions.logstats] INFO: Crawled 48 pages (at 12 pages/min), scraped 178 items (at 59 items/min)
2026-03-28 07:34:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 165MiB
2026-03-28 07:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8380df58-c81c-5787-b1d5-448b833904cc with identifier: XJ13626
2026-03-28 07:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8380df58-c81c-5787-b1d5-448b833904cc with identifier: XJ13626
2026-03-28 07:34:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8380df58-c81c-5787-b1d5-448b833904cc with identifier: XJ13626 to the API
2026-03-28 07:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 73,
'expiration_date': '2026-03-28T16:43:57Z',
'fuel_type': 'petrol',
'id': '8380df58-c81c-5787-b1d5-448b833904cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ13626',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 92567,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-05',
'seller_name': None,
'title': 'Renault Clio 1.2 Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2015}
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ13626%27 HTTP/1.1" 200 None
2026-03-28 07:34:07 [auto1.de] INFO: Saving data for XJ13626: {'auction_closing_time': 1774716237.0, 'created_time': 1774466119.587756, 'last_price_update_time': 1774683247.081824}
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ13626') HTTP/1.1" 204 0
2026-03-28 07:34:07 [auto1.de] INFO: Found listing with ID: SX22441
2026-03-28 07:34:07 [auto1.de] INFO: Found listing with ID: VL76600
2026-03-28 07:34:07 [auto1.de] INFO: Found listing with ID: VB93359
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB93359%27 HTTP/1.1" 200 None
2026-03-28 07:34:07 [auto1.de] INFO: Scrape type for VB93359: 0
2026-03-28 07:34:07 [auto1.de] INFO: Found listing with ID: CR93470
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR93470%27 HTTP/1.1" 200 None
2026-03-28 07:34:07 [auto1.de] INFO: Scrape type for CR93470: 0
2026-03-28 07:34:07 [auto1.de] INFO: Found listing with ID: FK98108
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK98108%27 HTTP/1.1" 200 None
2026-03-28 07:34:07 [auto1.de] INFO: Scrape type for FK98108: 0
2026-03-28 07:34:07 [auto1.de] INFO: Found listing with ID: LB19367
2026-03-28 07:34:07 [auto1.de] INFO: Found listing with ID: UG24808
2026-03-28 07:34:07 [auto1.de] INFO: Found listing with ID: ZM18653
2026-03-28 07:34:07 [auto1.de] INFO: Found listing with ID: BE16908
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE16908%27 HTTP/1.1" 200 None
2026-03-28 07:34:07 [auto1.de] INFO: Scrape type for BE16908: 0
2026-03-28 07:34:07 [auto1.de] INFO: Found listing with ID: HV99123
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV99123%27 HTTP/1.1" 200 None
2026-03-28 07:34:07 [auto1.de] INFO: Scrape type for HV99123: 0
2026-03-28 07:34:07 [auto1.de] INFO: Found listing with ID: WV85362
2026-03-28 07:34:07 [auto1.de] INFO: Found listing with ID: MR24892
2026-03-28 07:34:07 [auto1.de] INFO: Found listing with ID: KL40189
2026-03-28 07:34:07 [auto1.de] INFO: Found listing with ID: YS87471
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS87471%27 HTTP/1.1" 200 None
2026-03-28 07:34:07 [auto1.de] INFO: Scrape type for YS87471: 0
2026-03-28 07:34:07 [auto1.de] INFO: Found listing with ID: EJ76475
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ76475%27 HTTP/1.1" 200 None
2026-03-28 07:34:07 [auto1.de] INFO: Scrape type for EJ76475: 0
2026-03-28 07:34:07 [auto1.de] INFO: Found listing with ID: LL66986
2026-03-28 07:34:07 [auto1.de] INFO: Found listing with ID: UD68347
2026-03-28 07:34:07 [auto1.de] INFO: Found listing with ID: XE71423
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE71423%27 HTTP/1.1" 200 None
2026-03-28 07:34:07 [auto1.de] INFO: Scrape type for XE71423: 2
2026-03-28 07:34:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c821c103-10f5-541e-b21f-66a942041bcc with identifier: XE71423
2026-03-28 07:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c821c103-10f5-541e-b21f-66a942041bcc with scrape type 2
2026-03-28 07:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c821c103-10f5-541e-b21f-66a942041bcc with scrape type 2
2026-03-28 07:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c821c103-10f5-541e-b21f-66a942041bcc, identifier: XE71423
2026-03-28 07:34:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c821c103-10f5-541e-b21f-66a942041bcc with identifier: XE71423
2026-03-28 07:34:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c821c103-10f5-541e-b21f-66a942041bcc with identifier: XE71423
2026-03-28 07:34:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c821c103-10f5-541e-b21f-66a942041bcc with identifier: XE71423 to the API
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:21:32Z',
'fuel_type': 'petrol',
'id': 'c821c103-10f5-541e-b21f-66a942041bcc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE71423',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Vitara',
'odometer': 100535,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-18',
'seller_name': None,
'title': 'Suzuki Vitara 1.4 BoosterJet S 4x2',
'transmission': 'automatic',
'trim': 'S 4x2',
'year': 2016}
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE71423%27 HTTP/1.1" 200 None
2026-03-28 07:34:07 [auto1.de] INFO: Saving data for XE71423: {'auction_closing_time': 1774714892.0, 'created_time': 1773859464.302175, 'last_price_update_time': 1774683247.746875}
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE71423') HTTP/1.1" 204 0
2026-03-28 07:34:07 [auto1.de] INFO: Found listing with ID: SG45173
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG45173%27 HTTP/1.1" 200 None
2026-03-28 07:34:07 [auto1.de] INFO: Scrape type for SG45173: 2
2026-03-28 07:34:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b642dacb-0574-53a7-ba9c-15986f86269b with identifier: SG45173
2026-03-28 07:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b642dacb-0574-53a7-ba9c-15986f86269b with scrape type 2
2026-03-28 07:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b642dacb-0574-53a7-ba9c-15986f86269b with scrape type 2
2026-03-28 07:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b642dacb-0574-53a7-ba9c-15986f86269b, identifier: SG45173
2026-03-28 07:34:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b642dacb-0574-53a7-ba9c-15986f86269b with identifier: SG45173
2026-03-28 07:34:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b642dacb-0574-53a7-ba9c-15986f86269b with identifier: SG45173
2026-03-28 07:34:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b642dacb-0574-53a7-ba9c-15986f86269b with identifier: SG45173 to the API
2026-03-28 07:34:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:22:04Z',
'fuel_type': 'diesel',
'id': 'b642dacb-0574-53a7-ba9c-15986f86269b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG45173',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 87662,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-01',
'seller_name': None,
'title': 'BMW 5er 520d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2019}
2026-03-28 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG45173%27 HTTP/1.1" 200 None
2026-03-28 07:34:08 [auto1.de] INFO: Saving data for SG45173: {'auction_closing_time': 1774714924.0, 'created_time': 1774467928.74569, 'last_price_update_time': 1774683248.273518}
2026-03-28 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG45173') HTTP/1.1" 204 0
2026-03-28 07:34:08 [auto1.de] INFO: Found listing with ID: GV75599
2026-03-28 07:34:08 [auto1.de] INFO: Found listing with ID: UE69699
2026-03-28 07:34:08 [auto1.de] INFO: Found listing with ID: AN60754
2026-03-28 07:34:08 [auto1.de] INFO: Found listing with ID: YT66272
2026-03-28 07:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:34:09 [auto1.de] INFO: Channel: 24h | Page: 43 | totalHits: 9252 | hits on page: 40
2026-03-28 07:34:09 [auto1.de] INFO: Found listing with ID: YT66272
2026-03-28 07:34:09 [auto1.de] INFO: Found listing with ID: HR44152
2026-03-28 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR44152%27 HTTP/1.1" 200 None
2026-03-28 07:34:09 [auto1.de] INFO: Scrape type for HR44152: 0
2026-03-28 07:34:09 [auto1.de] INFO: Found listing with ID: JU26227
2026-03-28 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU26227%27 HTTP/1.1" 200 None
2026-03-28 07:34:09 [auto1.de] INFO: Scrape type for JU26227: 0
2026-03-28 07:34:09 [auto1.de] INFO: Found listing with ID: MK96538
2026-03-28 07:34:09 [auto1.de] INFO: Found listing with ID: DB03654
2026-03-28 07:34:09 [auto1.de] INFO: Found listing with ID: HN24396
2026-03-28 07:34:09 [auto1.de] INFO: Found listing with ID: KL31519
2026-03-28 07:34:09 [auto1.de] INFO: Found listing with ID: AY28505
2026-03-28 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY28505%27 HTTP/1.1" 200 None
2026-03-28 07:34:09 [auto1.de] INFO: Scrape type for AY28505: 0
2026-03-28 07:34:09 [auto1.de] INFO: Found listing with ID: LD63476
2026-03-28 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63476%27 HTTP/1.1" 200 None
2026-03-28 07:34:09 [auto1.de] INFO: Scrape type for LD63476: 0
2026-03-28 07:34:09 [auto1.de] INFO: Found listing with ID: DE25074
2026-03-28 07:34:09 [auto1.de] INFO: Found listing with ID: RU14902
2026-03-28 07:34:09 [auto1.de] INFO: Found listing with ID: LJ39551
2026-03-28 07:34:09 [auto1.de] INFO: Found listing with ID: FL34122
2026-03-28 07:34:09 [auto1.de] INFO: Found listing with ID: WT95105
2026-03-28 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT95105%27 HTTP/1.1" 200 None
2026-03-28 07:34:09 [auto1.de] INFO: Scrape type for WT95105: 0
2026-03-28 07:34:09 [auto1.de] INFO: Found listing with ID: RX16022
2026-03-28 07:34:09 [auto1.de] INFO: Found listing with ID: XR15758
2026-03-28 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR15758%27 HTTP/1.1" 200 None
2026-03-28 07:34:09 [auto1.de] INFO: Scrape type for XR15758: 0
2026-03-28 07:34:09 [auto1.de] INFO: Found listing with ID: YT74468
2026-03-28 07:34:09 [auto1.de] INFO: Found listing with ID: KA35826
2026-03-28 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA35826%27 HTTP/1.1" 200 None
2026-03-28 07:34:09 [auto1.de] INFO: Scrape type for KA35826: 2
2026-03-28 07:34:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2816aa87-3867-5e99-a0bc-7ade92acf708 with identifier: KA35826
2026-03-28 07:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2816aa87-3867-5e99-a0bc-7ade92acf708 with scrape type 2
2026-03-28 07:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2816aa87-3867-5e99-a0bc-7ade92acf708 with scrape type 2
2026-03-28 07:34:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2816aa87-3867-5e99-a0bc-7ade92acf708, identifier: KA35826
2026-03-28 07:34:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2816aa87-3867-5e99-a0bc-7ade92acf708 with identifier: KA35826
2026-03-28 07:34:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2816aa87-3867-5e99-a0bc-7ade92acf708 with identifier: KA35826
2026-03-28 07:34:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2816aa87-3867-5e99-a0bc-7ade92acf708 with identifier: KA35826 to the API
2026-03-28 07:34:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:32:29Z',
'fuel_type': 'petrol',
'id': '2816aa87-3867-5e99-a0bc-7ade92acf708',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA35826',
'listing': 'auction',
'make': 'Mazda',
'model': '3',
'odometer': 88725,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-11',
'seller_name': None,
'title': 'Mazda 3 1.6 Edition 125',
'transmission': 'manual',
'trim': 'Edition 125',
'year': 2011}
2026-03-28 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA35826%27 HTTP/1.1" 200 None
2026-03-28 07:34:09 [auto1.de] INFO: Saving data for KA35826: {'auction_closing_time': 1774715549.0, 'created_time': 1774468070.392116, 'last_price_update_time': 1774683249.628988}
2026-03-28 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA35826') HTTP/1.1" 204 0
2026-03-28 07:34:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:34:09 [auto1.de] INFO: Found listing with ID: RN29221
2026-03-28 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN29221%27 HTTP/1.1" 200 None
2026-03-28 07:34:09 [auto1.de] INFO: Scrape type for RN29221: 2
2026-03-28 07:34:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d47e59d8-1a82-5e46-b1fe-139ba17a3f07 with identifier: RN29221
2026-03-28 07:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d47e59d8-1a82-5e46-b1fe-139ba17a3f07 with scrape type 2
2026-03-28 07:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d47e59d8-1a82-5e46-b1fe-139ba17a3f07 with scrape type 2
2026-03-28 07:34:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d47e59d8-1a82-5e46-b1fe-139ba17a3f07, identifier: RN29221
2026-03-28 07:34:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d47e59d8-1a82-5e46-b1fe-139ba17a3f07 with identifier: RN29221
2026-03-28 07:34:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d47e59d8-1a82-5e46-b1fe-139ba17a3f07 with identifier: RN29221
2026-03-28 07:34:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d47e59d8-1a82-5e46-b1fe-139ba17a3f07 with identifier: RN29221 to the API
2026-03-28 07:34:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:49:19Z',
'fuel_type': 'diesel',
'id': 'd47e59d8-1a82-5e46-b1fe-139ba17a3f07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN29221',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Transporter',
'odometer': 131456,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-07',
'seller_name': None,
'title': 'Volkswagen T5 Transporter 2.0 TDI Kasten lang',
'transmission': 'manual',
'trim': 'Kasten lang',
'year': 2013}
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN29221%27 HTTP/1.1" 200 None
2026-03-28 07:34:10 [auto1.de] INFO: Saving data for RN29221: {'auction_closing_time': 1774716559.0, 'created_time': 1774463618.100699, 'last_price_update_time': 1774683250.184753}
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN29221') HTTP/1.1" 204 0
2026-03-28 07:34:10 [auto1.de] INFO: Found listing with ID: VX90434
2026-03-28 07:34:10 [auto1.de] INFO: Found listing with ID: XV23695
2026-03-28 07:34:10 [auto1.de] INFO: Found listing with ID: JW40764
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW40764%27 HTTP/1.1" 200 None
2026-03-28 07:34:10 [auto1.de] INFO: Scrape type for JW40764: 0
2026-03-28 07:34:10 [auto1.de] INFO: Found listing with ID: LM46522
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM46522%27 HTTP/1.1" 200 None
2026-03-28 07:34:10 [auto1.de] INFO: Scrape type for LM46522: 0
2026-03-28 07:34:10 [auto1.de] INFO: Found listing with ID: YN88329
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN88329%27 HTTP/1.1" 200 None
2026-03-28 07:34:10 [auto1.de] INFO: Scrape type for YN88329: 0
2026-03-28 07:34:10 [auto1.de] INFO: Found listing with ID: KA32583
2026-03-28 07:34:10 [auto1.de] INFO: Found listing with ID: BX26482
2026-03-28 07:34:10 [auto1.de] INFO: Found listing with ID: YE96502
2026-03-28 07:34:10 [auto1.de] INFO: Found listing with ID: ZW02435
2026-03-28 07:34:10 [auto1.de] INFO: Found listing with ID: CS43152
2026-03-28 07:34:10 [auto1.de] INFO: Found listing with ID: ZV83127
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV83127%27 HTTP/1.1" 200 None
2026-03-28 07:34:10 [auto1.de] INFO: Scrape type for ZV83127: 0
2026-03-28 07:34:10 [auto1.de] INFO: Found listing with ID: SX08307
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX08307%27 HTTP/1.1" 200 None
2026-03-28 07:34:10 [auto1.de] INFO: Scrape type for SX08307: 0
2026-03-28 07:34:10 [auto1.de] INFO: Found listing with ID: SD32112
2026-03-28 07:34:10 [auto1.de] INFO: Found listing with ID: WW55447
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW55447%27 HTTP/1.1" 200 None
2026-03-28 07:34:10 [auto1.de] INFO: Scrape type for WW55447: 0
2026-03-28 07:34:10 [auto1.de] INFO: Found listing with ID: XJ15035
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ15035%27 HTTP/1.1" 200 None
2026-03-28 07:34:10 [auto1.de] INFO: Scrape type for XJ15035: 0
2026-03-28 07:34:10 [auto1.de] INFO: Found listing with ID: JF53186
2026-03-28 07:34:10 [auto1.de] INFO: Found listing with ID: CU82641
2026-03-28 07:34:10 [auto1.de] INFO: Found listing with ID: GN50341
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN50341%27 HTTP/1.1" 200 None
2026-03-28 07:34:10 [auto1.de] INFO: Scrape type for GN50341: 0
2026-03-28 07:34:10 [auto1.de] INFO: Found listing with ID: ZM88762
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88762%27 HTTP/1.1" 200 None
2026-03-28 07:34:10 [auto1.de] INFO: Scrape type for ZM88762: 0
2026-03-28 07:34:10 [auto1.de] INFO: Found listing with ID: AG19353
2026-03-28 07:34:10 [auto1.de] INFO: Found listing with ID: XH14540
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH14540%27 HTTP/1.1" 200 None
2026-03-28 07:34:10 [auto1.de] INFO: Scrape type for XH14540: 0
2026-03-28 07:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:34:11 [auto1.de] INFO: Channel: 24h | Page: 44 | totalHits: 9252 | hits on page: 40
2026-03-28 07:34:11 [auto1.de] INFO: Found listing with ID: CL78510
2026-03-28 07:34:11 [auto1.de] INFO: Found listing with ID: MH03153
2026-03-28 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH03153%27 HTTP/1.1" 200 None
2026-03-28 07:34:11 [auto1.de] INFO: Scrape type for MH03153: 2
2026-03-28 07:34:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ae0c976-0729-563d-8a4a-a077f67321ea with identifier: MH03153
2026-03-28 07:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ae0c976-0729-563d-8a4a-a077f67321ea with scrape type 2
2026-03-28 07:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ae0c976-0729-563d-8a4a-a077f67321ea with scrape type 2
2026-03-28 07:34:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0ae0c976-0729-563d-8a4a-a077f67321ea, identifier: MH03153
2026-03-28 07:34:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0ae0c976-0729-563d-8a4a-a077f67321ea with identifier: MH03153
2026-03-28 07:34:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0ae0c976-0729-563d-8a4a-a077f67321ea with identifier: MH03153
2026-03-28 07:34:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0ae0c976-0729-563d-8a4a-a077f67321ea with identifier: MH03153 to the API
2026-03-28 07:34:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:14:10Z',
'fuel_type': 'petrol',
'id': '0ae0c976-0729-563d-8a4a-a077f67321ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH03153',
'listing': 'auction',
'make': 'Seat',
'model': 'Altea',
'odometer': 152014,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-02-21',
'seller_name': None,
'title': 'Seat Altea 1.6 Rebel',
'transmission': 'manual',
'trim': 'Rebel',
'year': 2007}
2026-03-28 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH03153%27 HTTP/1.1" 200 None
2026-03-28 07:34:11 [auto1.de] INFO: Saving data for MH03153: {'auction_closing_time': 1774714450.0, 'created_time': 1774465866.665885, 'last_price_update_time': 1774683251.720517}
2026-03-28 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH03153') HTTP/1.1" 204 0
2026-03-28 07:34:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:34:11 [auto1.de] INFO: Found listing with ID: FN85811
2026-03-28 07:34:11 [auto1.de] INFO: Found listing with ID: TR50455
2026-03-28 07:34:11 [auto1.de] INFO: Found listing with ID: RL02084
2026-03-28 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL02084%27 HTTP/1.1" 200 None
2026-03-28 07:34:11 [auto1.de] INFO: Scrape type for RL02084: 0
2026-03-28 07:34:11 [auto1.de] INFO: Found listing with ID: MV92494
2026-03-28 07:34:11 [auto1.de] INFO: Found listing with ID: JK78478
2026-03-28 07:34:11 [auto1.de] INFO: Found listing with ID: LL09458
2026-03-28 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09458%27 HTTP/1.1" 200 None
2026-03-28 07:34:11 [auto1.de] INFO: Scrape type for LL09458: 0
2026-03-28 07:34:11 [auto1.de] INFO: Found listing with ID: NX06422
2026-03-28 07:34:11 [auto1.de] INFO: Found listing with ID: ZG25746
2026-03-28 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG25746%27 HTTP/1.1" 200 None
2026-03-28 07:34:11 [auto1.de] INFO: Scrape type for ZG25746: 0
2026-03-28 07:34:11 [auto1.de] INFO: Found listing with ID: TA71788
2026-03-28 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA71788%27 HTTP/1.1" 200 None
2026-03-28 07:34:11 [auto1.de] INFO: Scrape type for TA71788: 0
2026-03-28 07:34:11 [auto1.de] INFO: Found listing with ID: BY41560
2026-03-28 07:34:11 [auto1.de] INFO: Found listing with ID: LJ93781
2026-03-28 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ93781%27 HTTP/1.1" 200 None
2026-03-28 07:34:11 [auto1.de] INFO: Scrape type for LJ93781: 0
2026-03-28 07:34:11 [auto1.de] INFO: Found listing with ID: MR54336
2026-03-28 07:34:11 [auto1.de] INFO: Found listing with ID: CG53828
2026-03-28 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG53828%27 HTTP/1.1" 200 None
2026-03-28 07:34:11 [auto1.de] INFO: Scrape type for CG53828: 0
2026-03-28 07:34:11 [auto1.de] INFO: Found listing with ID: CL40632
2026-03-28 07:34:11 [auto1.de] INFO: Found listing with ID: VR71281
2026-03-28 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR71281%27 HTTP/1.1" 200 None
2026-03-28 07:34:11 [auto1.de] INFO: Scrape type for VR71281: 2
2026-03-28 07:34:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82c0ec25-2782-5596-821f-5e98c73d3e43 with identifier: VR71281
2026-03-28 07:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82c0ec25-2782-5596-821f-5e98c73d3e43 with scrape type 2
2026-03-28 07:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82c0ec25-2782-5596-821f-5e98c73d3e43 with scrape type 2
2026-03-28 07:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82c0ec25-2782-5596-821f-5e98c73d3e43, identifier: VR71281
2026-03-28 07:34:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82c0ec25-2782-5596-821f-5e98c73d3e43 with identifier: VR71281
2026-03-28 07:34:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82c0ec25-2782-5596-821f-5e98c73d3e43 with identifier: VR71281
2026-03-28 07:34:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82c0ec25-2782-5596-821f-5e98c73d3e43 with identifier: VR71281 to the API
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:48:06Z',
'fuel_type': 'diesel',
'id': '82c0ec25-2782-5596-821f-5e98c73d3e43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR71281',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 195685,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-05',
'seller_name': None,
'title': 'Skoda Octavia 1.6 TDI Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2013}
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR71281%27 HTTP/1.1" 200 None
2026-03-28 07:34:12 [auto1.de] INFO: Saving data for VR71281: {'auction_closing_time': 1774716486.0, 'created_time': 1774032242.219691, 'last_price_update_time': 1774683252.345529}
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR71281') HTTP/1.1" 204 0
2026-03-28 07:34:12 [auto1.de] INFO: Found listing with ID: PB95910
2026-03-28 07:34:12 [auto1.de] INFO: Found listing with ID: YJ24873
2026-03-28 07:34:12 [auto1.de] INFO: Found listing with ID: RW72462
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW72462%27 HTTP/1.1" 200 None
2026-03-28 07:34:12 [auto1.de] INFO: Scrape type for RW72462: 0
2026-03-28 07:34:12 [auto1.de] INFO: Found listing with ID: AP99471
2026-03-28 07:34:12 [auto1.de] INFO: Found listing with ID: FN87515
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN87515%27 HTTP/1.1" 200 None
2026-03-28 07:34:12 [auto1.de] INFO: Scrape type for FN87515: 0
2026-03-28 07:34:12 [auto1.de] INFO: Found listing with ID: WX25953
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX25953%27 HTTP/1.1" 200 None
2026-03-28 07:34:12 [auto1.de] INFO: Scrape type for WX25953: 0
2026-03-28 07:34:12 [auto1.de] INFO: Found listing with ID: EJ74150
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ74150%27 HTTP/1.1" 200 None
2026-03-28 07:34:12 [auto1.de] INFO: Scrape type for EJ74150: 0
2026-03-28 07:34:12 [auto1.de] INFO: Found listing with ID: RL49502
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL49502%27 HTTP/1.1" 200 None
2026-03-28 07:34:12 [auto1.de] INFO: Scrape type for RL49502: 0
2026-03-28 07:34:12 [auto1.de] INFO: Found listing with ID: MK13186
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK13186%27 HTTP/1.1" 200 None
2026-03-28 07:34:12 [auto1.de] INFO: Scrape type for MK13186: 0
2026-03-28 07:34:12 [auto1.de] INFO: Found listing with ID: PG02615
2026-03-28 07:34:12 [auto1.de] INFO: Found listing with ID: VR30275
2026-03-28 07:34:12 [auto1.de] INFO: Found listing with ID: GC30082
2026-03-28 07:34:12 [auto1.de] INFO: Found listing with ID: AH51648
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH51648%27 HTTP/1.1" 200 None
2026-03-28 07:34:12 [auto1.de] INFO: Scrape type for AH51648: 2
2026-03-28 07:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 656677fa-90af-5c01-acc4-97442c9f5002 with identifier: AH51648
2026-03-28 07:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 656677fa-90af-5c01-acc4-97442c9f5002 with scrape type 2
2026-03-28 07:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 656677fa-90af-5c01-acc4-97442c9f5002 with scrape type 2
2026-03-28 07:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 656677fa-90af-5c01-acc4-97442c9f5002, identifier: AH51648
2026-03-28 07:34:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 656677fa-90af-5c01-acc4-97442c9f5002 with identifier: AH51648
2026-03-28 07:34:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 656677fa-90af-5c01-acc4-97442c9f5002 with identifier: AH51648
2026-03-28 07:34:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 656677fa-90af-5c01-acc4-97442c9f5002 with identifier: AH51648 to the API
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:05:37Z',
'fuel_type': 'diesel',
'id': '656677fa-90af-5c01-acc4-97442c9f5002',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH51648',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 153286,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-15',
'seller_name': None,
'title': 'Audi Q3 2.0 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2016}
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH51648%27 HTTP/1.1" 200 None
2026-03-28 07:34:12 [auto1.de] INFO: Saving data for AH51648: {'auction_closing_time': 1774713937.0, 'created_time': 1774467446.543028, 'last_price_update_time': 1774683252.953261}
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH51648') HTTP/1.1" 204 0
2026-03-28 07:34:13 [auto1.de] INFO: Found listing with ID: SK62932
2026-03-28 07:34:13 [auto1.de] INFO: Found listing with ID: BM74248
2026-03-28 07:34:13 [auto1.de] INFO: Found listing with ID: WU59517
2026-03-28 07:34:13 [auto1.de] INFO: Found listing with ID: CC55438
2026-03-28 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC55438%27 HTTP/1.1" 200 None
2026-03-28 07:34:13 [auto1.de] INFO: Scrape type for CC55438: 2
2026-03-28 07:34:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46770eb6-9132-56e6-876b-f993d53b14dd with identifier: CC55438
2026-03-28 07:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46770eb6-9132-56e6-876b-f993d53b14dd with scrape type 2
2026-03-28 07:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46770eb6-9132-56e6-876b-f993d53b14dd with scrape type 2
2026-03-28 07:34:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46770eb6-9132-56e6-876b-f993d53b14dd, identifier: CC55438
2026-03-28 07:34:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46770eb6-9132-56e6-876b-f993d53b14dd with identifier: CC55438
2026-03-28 07:34:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46770eb6-9132-56e6-876b-f993d53b14dd with identifier: CC55438
2026-03-28 07:34:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46770eb6-9132-56e6-876b-f993d53b14dd with identifier: CC55438 to the API
2026-03-28 07:34:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 250,
'expiration_date': '2026-03-28T16:52:28Z',
'fuel_type': 'diesel',
'id': '46770eb6-9132-56e6-876b-f993d53b14dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC55438',
'listing': 'auction',
'make': 'Jeep',
'model': 'Grand Cherokee',
'odometer': 118261,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-10',
'seller_name': None,
'title': 'Jeep Grand Cherokee 3.0 CRD Overland',
'transmission': 'automatic',
'trim': 'Overland',
'year': 2016}
2026-03-28 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC55438%27 HTTP/1.1" 200 None
2026-03-28 07:34:13 [auto1.de] INFO: Saving data for CC55438: {'auction_closing_time': 1774716748.0, 'created_time': 1773302092.419733, 'last_price_update_time': 1774683253.474109}
2026-03-28 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC55438') HTTP/1.1" 204 0
2026-03-28 07:34:13 [auto1.de] INFO: Found listing with ID: ZD07127
2026-03-28 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD07127%27 HTTP/1.1" 200 None
2026-03-28 07:34:13 [auto1.de] INFO: Scrape type for ZD07127: 0
2026-03-28 07:34:13 [auto1.de] INFO: Found listing with ID: WH84573
2026-03-28 07:34:13 [auto1.de] INFO: Found listing with ID: SR89138
2026-03-28 07:34:13 [auto1.de] INFO: Found listing with ID: WA89012
2026-03-28 07:34:13 [auto1.de] INFO: Found listing with ID: HW40680
2026-03-28 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW40680%27 HTTP/1.1" 200 None
2026-03-28 07:34:13 [auto1.de] INFO: Scrape type for HW40680: 0
2026-03-28 07:34:13 [auto1.de] INFO: Found listing with ID: JM30050
2026-03-28 07:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:34:45 [auto1.de] INFO: Channel: 24h | Page: 45 | totalHits: 9252 | hits on page: 40
2026-03-28 07:34:45 [auto1.de] INFO: Found listing with ID: CJ89630
2026-03-28 07:34:45 [auto1.de] INFO: Found listing with ID: AM64478
2026-03-28 07:34:45 [auto1.de] INFO: Found listing with ID: BY97768
2026-03-28 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY97768%27 HTTP/1.1" 200 None
2026-03-28 07:34:45 [auto1.de] INFO: Scrape type for BY97768: 0
2026-03-28 07:34:45 [auto1.de] INFO: Found listing with ID: UB98859
2026-03-28 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB98859%27 HTTP/1.1" 200 None
2026-03-28 07:34:45 [auto1.de] INFO: Scrape type for UB98859: 2
2026-03-28 07:34:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 512753e6-5818-5875-b5ca-ab325f6a34e0 with identifier: UB98859
2026-03-28 07:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 512753e6-5818-5875-b5ca-ab325f6a34e0 with scrape type 2
2026-03-28 07:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 512753e6-5818-5875-b5ca-ab325f6a34e0 with scrape type 2
2026-03-28 07:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 512753e6-5818-5875-b5ca-ab325f6a34e0, identifier: UB98859
2026-03-28 07:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 512753e6-5818-5875-b5ca-ab325f6a34e0 with identifier: UB98859
2026-03-28 07:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 512753e6-5818-5875-b5ca-ab325f6a34e0 with identifier: UB98859
2026-03-28 07:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 512753e6-5818-5875-b5ca-ab325f6a34e0 with identifier: UB98859 to the API
2026-03-28 07:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:54:20Z',
'fuel_type': 'petrol',
'id': '512753e6-5818-5875-b5ca-ab325f6a34e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB98859',
'listing': 'auction',
'make': 'Fiat',
'model': 'Grande Punto',
'odometer': 72763,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-27',
'seller_name': None,
'title': 'Fiat Grande Punto 1.2 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2012}
2026-03-28 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB98859%27 HTTP/1.1" 200 None
2026-03-28 07:34:45 [auto1.de] INFO: Saving data for UB98859: {'auction_closing_time': 1774716860.0, 'created_time': 1774467676.568574, 'last_price_update_time': 1774683285.454833}
2026-03-28 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB98859') HTTP/1.1" 204 0
2026-03-28 07:34:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:34:45 [auto1.de] INFO: Found listing with ID: ZY22077
2026-03-28 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY22077%27 HTTP/1.1" 200 None
2026-03-28 07:34:45 [auto1.de] INFO: Scrape type for ZY22077: 0
2026-03-28 07:34:45 [auto1.de] INFO: Found listing with ID: MY96813
2026-03-28 07:34:45 [auto1.de] INFO: Found listing with ID: RD80564
2026-03-28 07:34:45 [auto1.de] INFO: Found listing with ID: NB75703
2026-03-28 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB75703%27 HTTP/1.1" 200 None
2026-03-28 07:34:45 [auto1.de] INFO: Scrape type for NB75703: 2
2026-03-28 07:34:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dce4eb07-a3d7-566e-93c1-8232d8a7373b with identifier: NB75703
2026-03-28 07:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dce4eb07-a3d7-566e-93c1-8232d8a7373b with scrape type 2
2026-03-28 07:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dce4eb07-a3d7-566e-93c1-8232d8a7373b with scrape type 2
2026-03-28 07:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dce4eb07-a3d7-566e-93c1-8232d8a7373b, identifier: NB75703
2026-03-28 07:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dce4eb07-a3d7-566e-93c1-8232d8a7373b with identifier: NB75703
2026-03-28 07:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dce4eb07-a3d7-566e-93c1-8232d8a7373b with identifier: NB75703
2026-03-28 07:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dce4eb07-a3d7-566e-93c1-8232d8a7373b with identifier: NB75703 to the API
2026-03-28 07:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:09:15Z',
'fuel_type': 'petrol',
'id': 'dce4eb07-a3d7-566e-93c1-8232d8a7373b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB75703',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 81060,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-11',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2013}
2026-03-28 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB75703%27 HTTP/1.1" 200 None
2026-03-28 07:34:46 [auto1.de] INFO: Saving data for NB75703: {'auction_closing_time': 1774714155.0, 'created_time': 1774467949.226354, 'last_price_update_time': 1774683286.037214}
2026-03-28 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB75703') HTTP/1.1" 204 0
2026-03-28 07:34:46 [auto1.de] INFO: Found listing with ID: RY65536
2026-03-28 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY65536%27 HTTP/1.1" 200 None
2026-03-28 07:34:46 [auto1.de] INFO: Scrape type for RY65536: 2
2026-03-28 07:34:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7aec37fb-db8f-52a8-8f91-857619af2966 with identifier: RY65536
2026-03-28 07:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aec37fb-db8f-52a8-8f91-857619af2966 with scrape type 2
2026-03-28 07:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7aec37fb-db8f-52a8-8f91-857619af2966 with scrape type 2
2026-03-28 07:34:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7aec37fb-db8f-52a8-8f91-857619af2966, identifier: RY65536
2026-03-28 07:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7aec37fb-db8f-52a8-8f91-857619af2966 with identifier: RY65536
2026-03-28 07:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7aec37fb-db8f-52a8-8f91-857619af2966 with identifier: RY65536
2026-03-28 07:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7aec37fb-db8f-52a8-8f91-857619af2966 with identifier: RY65536 to the API
2026-03-28 07:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 212,
'expiration_date': '2026-03-28T16:49:02Z',
'fuel_type': 'diesel',
'id': '7aec37fb-db8f-52a8-8f91-857619af2966',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY65536',
'listing': 'auction',
'make': 'Ford',
'model': 'Ranger',
'odometer': 72687,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-22',
'seller_name': None,
'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Limited',
'transmission': 'automatic',
'trim': 'Doppelkabine 4x4 Limited',
'year': 2019}
2026-03-28 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY65536%27 HTTP/1.1" 200 None
2026-03-28 07:34:46 [auto1.de] INFO: Saving data for RY65536: {'auction_closing_time': 1774716542.0, 'created_time': 1774464080.85492, 'last_price_update_time': 1774683286.528984}
2026-03-28 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY65536') HTTP/1.1" 204 0
2026-03-28 07:34:46 [auto1.de] INFO: Found listing with ID: UZ04747
2026-03-28 07:34:46 [auto1.de] INFO: Found listing with ID: GU28360
2026-03-28 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU28360%27 HTTP/1.1" 200 None
2026-03-28 07:34:46 [auto1.de] INFO: Scrape type for GU28360: 0
2026-03-28 07:34:46 [auto1.de] INFO: Found listing with ID: CW72943
2026-03-28 07:34:46 [auto1.de] INFO: Found listing with ID: KC84563
2026-03-28 07:34:46 [auto1.de] INFO: Found listing with ID: DN26053
2026-03-28 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN26053%27 HTTP/1.1" 200 None
2026-03-28 07:34:46 [auto1.de] INFO: Scrape type for DN26053: 0
2026-03-28 07:34:46 [auto1.de] INFO: Found listing with ID: RA53800
2026-03-28 07:34:46 [auto1.de] INFO: Found listing with ID: TK31423
2026-03-28 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK31423%27 HTTP/1.1" 200 None
2026-03-28 07:34:46 [auto1.de] INFO: Scrape type for TK31423: 0
2026-03-28 07:34:46 [auto1.de] INFO: Found listing with ID: CN66331
2026-03-28 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN66331%27 HTTP/1.1" 200 None
2026-03-28 07:34:46 [auto1.de] INFO: Scrape type for CN66331: 2
2026-03-28 07:34:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37197d0f-1265-5179-87ab-65c60b009c32 with identifier: CN66331
2026-03-28 07:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37197d0f-1265-5179-87ab-65c60b009c32 with scrape type 2
2026-03-28 07:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37197d0f-1265-5179-87ab-65c60b009c32 with scrape type 2
2026-03-28 07:34:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37197d0f-1265-5179-87ab-65c60b009c32, identifier: CN66331
2026-03-28 07:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37197d0f-1265-5179-87ab-65c60b009c32 with identifier: CN66331
2026-03-28 07:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37197d0f-1265-5179-87ab-65c60b009c32 with identifier: CN66331
2026-03-28 07:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37197d0f-1265-5179-87ab-65c60b009c32 with identifier: CN66331 to the API
2026-03-28 07:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:14:08Z',
'fuel_type': 'petrol',
'id': '37197d0f-1265-5179-87ab-65c60b009c32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN66331',
'listing': 'auction',
'make': 'Lancia',
'model': 'Ypsilon',
'odometer': 999999,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-11-23',
'seller_name': None,
'title': 'Lancia Ypsilon 1.4 Platino',
'transmission': 'manual',
'trim': 'Platino',
'year': 2006}
2026-03-28 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN66331%27 HTTP/1.1" 200 None
2026-03-28 07:34:47 [auto1.de] INFO: Saving data for CN66331: {'auction_closing_time': 1774714448.0, 'created_time': 1773860023.672412, 'last_price_update_time': 1774683287.036136}
2026-03-28 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN66331') HTTP/1.1" 204 0
2026-03-28 07:34:47 [auto1.de] INFO: Found listing with ID: XR50139
2026-03-28 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR50139%27 HTTP/1.1" 200 None
2026-03-28 07:34:47 [auto1.de] INFO: Scrape type for XR50139: 0
2026-03-28 07:34:47 [auto1.de] INFO: Found listing with ID: GV67460
2026-03-28 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV67460%27 HTTP/1.1" 200 None
2026-03-28 07:34:47 [auto1.de] INFO: Scrape type for GV67460: 0
2026-03-28 07:34:47 [auto1.de] INFO: Found listing with ID: KT16474
2026-03-28 07:34:47 [auto1.de] INFO: Found listing with ID: GE45288
2026-03-28 07:34:47 [auto1.de] INFO: Found listing with ID: HU68423
2026-03-28 07:34:47 [auto1.de] INFO: Found listing with ID: SW13301
2026-03-28 07:34:47 [auto1.de] INFO: Found listing with ID: GU66110
2026-03-28 07:34:47 [auto1.de] INFO: Found listing with ID: PP17491
2026-03-28 07:34:47 [auto1.de] INFO: Found listing with ID: JJ86337
2026-03-28 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ86337%27 HTTP/1.1" 200 None
2026-03-28 07:34:47 [auto1.de] INFO: Scrape type for JJ86337: 2
2026-03-28 07:34:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4da0835b-ec00-56c2-ae72-5a2f143d60c4 with identifier: JJ86337
2026-03-28 07:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4da0835b-ec00-56c2-ae72-5a2f143d60c4 with scrape type 2
2026-03-28 07:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4da0835b-ec00-56c2-ae72-5a2f143d60c4 with scrape type 2
2026-03-28 07:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4da0835b-ec00-56c2-ae72-5a2f143d60c4, identifier: JJ86337
2026-03-28 07:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4da0835b-ec00-56c2-ae72-5a2f143d60c4 with identifier: JJ86337
2026-03-28 07:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4da0835b-ec00-56c2-ae72-5a2f143d60c4 with identifier: JJ86337
2026-03-28 07:34:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4da0835b-ec00-56c2-ae72-5a2f143d60c4 with identifier: JJ86337 to the API
2026-03-28 07:34:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:09:12Z',
'fuel_type': 'diesel',
'id': '4da0835b-ec00-56c2-ae72-5a2f143d60c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ86337',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 181514,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-02',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style BlueMotion Tech',
'transmission': 'manual',
'trim': 'Sport & Style BlueMotion Tech',
'year': 2013}
2026-03-28 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ86337%27 HTTP/1.1" 200 None
2026-03-28 07:34:47 [auto1.de] INFO: Saving data for JJ86337: {'auction_closing_time': 1774714152.0, 'created_time': 1774464006.123804, 'last_price_update_time': 1774683287.612506}
2026-03-28 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ86337') HTTP/1.1" 204 0
2026-03-28 07:34:47 [auto1.de] INFO: Found listing with ID: KG76209
2026-03-28 07:34:47 [auto1.de] INFO: Found listing with ID: XY94981
2026-03-28 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY94981%27 HTTP/1.1" 200 None
2026-03-28 07:34:47 [auto1.de] INFO: Scrape type for XY94981: 0
2026-03-28 07:34:47 [auto1.de] INFO: Found listing with ID: LD43960
2026-03-28 07:34:47 [auto1.de] INFO: Found listing with ID: TL90122
2026-03-28 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL90122%27 HTTP/1.1" 200 None
2026-03-28 07:34:47 [auto1.de] INFO: Scrape type for TL90122: 0
2026-03-28 07:34:47 [auto1.de] INFO: Found listing with ID: KH49369
2026-03-28 07:34:47 [auto1.de] INFO: Found listing with ID: EW55752
2026-03-28 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW55752%27 HTTP/1.1" 200 None
2026-03-28 07:34:47 [auto1.de] INFO: Scrape type for EW55752: 0
2026-03-28 07:34:47 [auto1.de] INFO: Found listing with ID: DB79259
2026-03-28 07:34:47 [auto1.de] INFO: Found listing with ID: GA76856
2026-03-28 07:34:47 [auto1.de] INFO: Found listing with ID: PH48180
2026-03-28 07:34:47 [auto1.de] INFO: Found listing with ID: KZ06018
2026-03-28 07:34:47 [auto1.de] INFO: Found listing with ID: RD35466
2026-03-28 07:34:47 [auto1.de] INFO: Found listing with ID: JE00015
2026-03-28 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE00015%27 HTTP/1.1" 200 None
2026-03-28 07:34:47 [auto1.de] INFO: Scrape type for JE00015: 0
2026-03-28 07:34:47 [auto1.de] INFO: Found listing with ID: LC81158
2026-03-28 07:34:47 [auto1.de] INFO: Found listing with ID: RD90003
2026-03-28 07:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:34:48 [auto1.de] INFO: Channel: 24h | Page: 46 | totalHits: 9252 | hits on page: 40
2026-03-28 07:34:48 [auto1.de] INFO: Found listing with ID: LY63644
2026-03-28 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY63644%27 HTTP/1.1" 200 None
2026-03-28 07:34:48 [auto1.de] INFO: Scrape type for LY63644: 0
2026-03-28 07:34:48 [auto1.de] INFO: Found listing with ID: VY77073
2026-03-28 07:34:48 [auto1.de] INFO: Found listing with ID: ZK29969
2026-03-28 07:34:48 [auto1.de] INFO: Found listing with ID: RF30152
2026-03-28 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF30152%27 HTTP/1.1" 200 None
2026-03-28 07:34:48 [auto1.de] INFO: Scrape type for RF30152: 2
2026-03-28 07:34:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63daa700-08c6-549a-8c2b-08332cddf4ed with identifier: RF30152
2026-03-28 07:34:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63daa700-08c6-549a-8c2b-08332cddf4ed with scrape type 2
2026-03-28 07:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63daa700-08c6-549a-8c2b-08332cddf4ed with scrape type 2
2026-03-28 07:34:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63daa700-08c6-549a-8c2b-08332cddf4ed, identifier: RF30152
2026-03-28 07:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63daa700-08c6-549a-8c2b-08332cddf4ed with identifier: RF30152
2026-03-28 07:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63daa700-08c6-549a-8c2b-08332cddf4ed with identifier: RF30152
2026-03-28 07:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63daa700-08c6-549a-8c2b-08332cddf4ed with identifier: RF30152 to the API
2026-03-28 07:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:27:01Z',
'fuel_type': 'diesel',
'id': '63daa700-08c6-549a-8c2b-08332cddf4ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF30152',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 32970,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-29',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2022}
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF30152%27 HTTP/1.1" 200 None
2026-03-28 07:34:49 [auto1.de] INFO: Saving data for RF30152: {'auction_closing_time': 1774715221.0, 'created_time': 1774467815.353713, 'last_price_update_time': 1774683289.190752}
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF30152') HTTP/1.1" 204 0
2026-03-28 07:34:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:34:49 [auto1.de] INFO: Found listing with ID: PC09309
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC09309%27 HTTP/1.1" 200 None
2026-03-28 07:34:49 [auto1.de] INFO: Scrape type for PC09309: 0
2026-03-28 07:34:49 [auto1.de] INFO: Found listing with ID: ZS59678
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS59678%27 HTTP/1.1" 200 None
2026-03-28 07:34:49 [auto1.de] INFO: Scrape type for ZS59678: 0
2026-03-28 07:34:49 [auto1.de] INFO: Found listing with ID: NC92529
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC92529%27 HTTP/1.1" 200 None
2026-03-28 07:34:49 [auto1.de] INFO: Scrape type for NC92529: 0
2026-03-28 07:34:49 [auto1.de] INFO: Found listing with ID: CG78657
2026-03-28 07:34:49 [auto1.de] INFO: Found listing with ID: SC50732
2026-03-28 07:34:49 [auto1.de] INFO: Found listing with ID: VY07286
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY07286%27 HTTP/1.1" 200 None
2026-03-28 07:34:49 [auto1.de] INFO: Scrape type for VY07286: 0
2026-03-28 07:34:49 [auto1.de] INFO: Found listing with ID: KP41876
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP41876%27 HTTP/1.1" 200 None
2026-03-28 07:34:49 [auto1.de] INFO: Scrape type for KP41876: 0
2026-03-28 07:34:49 [auto1.de] INFO: Found listing with ID: JD70113
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD70113%27 HTTP/1.1" 200 None
2026-03-28 07:34:49 [auto1.de] INFO: Scrape type for JD70113: 0
2026-03-28 07:34:49 [auto1.de] INFO: Found listing with ID: FK64701
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK64701%27 HTTP/1.1" 200 None
2026-03-28 07:34:49 [auto1.de] INFO: Scrape type for FK64701: 0
2026-03-28 07:34:49 [auto1.de] INFO: Found listing with ID: LM88961
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM88961%27 HTTP/1.1" 200 None
2026-03-28 07:34:49 [auto1.de] INFO: Scrape type for LM88961: 0
2026-03-28 07:34:49 [auto1.de] INFO: Found listing with ID: MA76308
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA76308%27 HTTP/1.1" 200 None
2026-03-28 07:34:49 [auto1.de] INFO: Scrape type for MA76308: 0
2026-03-28 07:34:49 [auto1.de] INFO: Found listing with ID: AV13612
2026-03-28 07:34:49 [auto1.de] INFO: Found listing with ID: EF37274
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF37274%27 HTTP/1.1" 200 None
2026-03-28 07:34:49 [auto1.de] INFO: Scrape type for EF37274: 2
2026-03-28 07:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14ddbca3-53c5-5f2b-a059-176d18b0193a with identifier: EF37274
2026-03-28 07:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14ddbca3-53c5-5f2b-a059-176d18b0193a with scrape type 2
2026-03-28 07:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14ddbca3-53c5-5f2b-a059-176d18b0193a with scrape type 2
2026-03-28 07:34:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14ddbca3-53c5-5f2b-a059-176d18b0193a, identifier: EF37274
2026-03-28 07:34:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14ddbca3-53c5-5f2b-a059-176d18b0193a with identifier: EF37274
2026-03-28 07:34:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14ddbca3-53c5-5f2b-a059-176d18b0193a with identifier: EF37274
2026-03-28 07:34:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14ddbca3-53c5-5f2b-a059-176d18b0193a with identifier: EF37274 to the API
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:52:34Z',
'fuel_type': 'petrol',
'id': '14ddbca3-53c5-5f2b-a059-176d18b0193a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF37274',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 177702,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-11-30',
'seller_name': None,
'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
'transmission': 'automatic',
'trim': 'Micro Hybrid Drive passion',
'year': 2007}
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF37274%27 HTTP/1.1" 200 None
2026-03-28 07:34:49 [auto1.de] INFO: Saving data for EF37274: {'auction_closing_time': 1774716754.0, 'created_time': 1774466258.342977, 'last_price_update_time': 1774683289.865336}
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EF37274') HTTP/1.1" 204 0
2026-03-28 07:34:49 [auto1.de] INFO: Found listing with ID: KR19080
2026-03-28 07:34:49 [auto1.de] INFO: Found listing with ID: GD52714
2026-03-28 07:34:49 [auto1.de] INFO: Found listing with ID: KA14077
2026-03-28 07:34:49 [auto1.de] INFO: Found listing with ID: SD59172
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD59172%27 HTTP/1.1" 200 None
2026-03-28 07:34:49 [auto1.de] INFO: Scrape type for SD59172: 0
2026-03-28 07:34:49 [auto1.de] INFO: Found listing with ID: KG91640
2026-03-28 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG91640%27 HTTP/1.1" 200 None
2026-03-28 07:34:50 [auto1.de] INFO: Scrape type for KG91640: 2
2026-03-28 07:34:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d7fa862-3b9c-540d-8ebd-3704d52a78ce with identifier: KG91640
2026-03-28 07:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d7fa862-3b9c-540d-8ebd-3704d52a78ce with scrape type 2
2026-03-28 07:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d7fa862-3b9c-540d-8ebd-3704d52a78ce with scrape type 2
2026-03-28 07:34:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d7fa862-3b9c-540d-8ebd-3704d52a78ce, identifier: KG91640
2026-03-28 07:34:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d7fa862-3b9c-540d-8ebd-3704d52a78ce with identifier: KG91640
2026-03-28 07:34:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d7fa862-3b9c-540d-8ebd-3704d52a78ce with identifier: KG91640
2026-03-28 07:34:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d7fa862-3b9c-540d-8ebd-3704d52a78ce with identifier: KG91640 to the API
2026-03-28 07:34:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:53:40Z',
'fuel_type': 'petrol',
'id': '5d7fa862-3b9c-540d-8ebd-3704d52a78ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG91640',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 108757,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-05-02',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 Cricket',
'transmission': 'manual',
'trim': 'Cricket',
'year': 2004}
2026-03-28 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG91640%27 HTTP/1.1" 200 None
2026-03-28 07:34:50 [auto1.de] INFO: Saving data for KG91640: {'auction_closing_time': 1774716820.0, 'created_time': 1774465957.775526, 'last_price_update_time': 1774683290.406559}
2026-03-28 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG91640') HTTP/1.1" 204 0
2026-03-28 07:34:50 [auto1.de] INFO: Found listing with ID: KM15369
2026-03-28 07:34:50 [auto1.de] INFO: Found listing with ID: AR18568
2026-03-28 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR18568%27 HTTP/1.1" 200 None
2026-03-28 07:34:50 [auto1.de] INFO: Scrape type for AR18568: 0
2026-03-28 07:34:50 [auto1.de] INFO: Found listing with ID: VA30007
2026-03-28 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA30007%27 HTTP/1.1" 200 None
2026-03-28 07:34:50 [auto1.de] INFO: Scrape type for VA30007: 2
2026-03-28 07:34:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa245c2f-28bb-5300-8be3-7893abeb3000 with identifier: VA30007
2026-03-28 07:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa245c2f-28bb-5300-8be3-7893abeb3000 with scrape type 2
2026-03-28 07:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa245c2f-28bb-5300-8be3-7893abeb3000 with scrape type 2
2026-03-28 07:34:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa245c2f-28bb-5300-8be3-7893abeb3000, identifier: VA30007
2026-03-28 07:34:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa245c2f-28bb-5300-8be3-7893abeb3000 with identifier: VA30007
2026-03-28 07:34:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:34:50 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=other HTTP/1.1" 200 None
2026-03-28 07:34:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:34:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa245c2f-28bb-5300-8be3-7893abeb3000 with identifier: VA30007
2026-03-28 07:34:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa245c2f-28bb-5300-8be3-7893abeb3000 with identifier: VA30007 to the API
2026-03-28 07:34:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'other',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 181,
'expiration_date': '2026-03-28T16:17:03Z',
'fuel_type': 'hybrid',
'id': 'aa245c2f-28bb-5300-8be3-7893abeb3000',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA30007',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 48504,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-19',
'seller_name': None,
'title': 'Opel Astra 1.6 Plug-in Hybrid Edition',
'transmission': 'automatic',
'trim': 'Edition',
'year': 2022}
2026-03-28 07:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA30007%27 HTTP/1.1" 200 None
2026-03-28 07:34:51 [auto1.de] INFO: Saving data for VA30007: {'auction_closing_time': 1774714623.0, 'created_time': 1774463653.421972, 'last_price_update_time': 1774683291.007227}
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VA30007') HTTP/1.1" 204 0
2026-03-28 07:34:51 [auto1.de] INFO: Found listing with ID: RG19344
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG19344%27 HTTP/1.1" 200 None
2026-03-28 07:34:51 [auto1.de] INFO: Scrape type for RG19344: 0
2026-03-28 07:34:51 [auto1.de] INFO: Found listing with ID: WK90635
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK90635%27 HTTP/1.1" 200 None
2026-03-28 07:34:51 [auto1.de] INFO: Scrape type for WK90635: 0
2026-03-28 07:34:51 [auto1.de] INFO: Found listing with ID: NZ71829
2026-03-28 07:34:51 [auto1.de] INFO: Found listing with ID: PH25486
2026-03-28 07:34:51 [auto1.de] INFO: Found listing with ID: HE99483
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE99483%27 HTTP/1.1" 200 None
2026-03-28 07:34:51 [auto1.de] INFO: Scrape type for HE99483: 0
2026-03-28 07:34:51 [auto1.de] INFO: Found listing with ID: YX52841
2026-03-28 07:34:51 [auto1.de] INFO: Found listing with ID: GP94559
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP94559%27 HTTP/1.1" 200 None
2026-03-28 07:34:51 [auto1.de] INFO: Scrape type for GP94559: 0
2026-03-28 07:34:51 [auto1.de] INFO: Found listing with ID: KF79768
2026-03-28 07:34:51 [auto1.de] INFO: Found listing with ID: AW04202
2026-03-28 07:34:51 [auto1.de] INFO: Found listing with ID: LS62630
2026-03-28 07:34:51 [auto1.de] INFO: Found listing with ID: GY70112
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY70112%27 HTTP/1.1" 200 None
2026-03-28 07:34:51 [auto1.de] INFO: Scrape type for GY70112: 2
2026-03-28 07:34:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be89717b-7dea-5a92-8ea6-c7ac9869a7f6 with identifier: GY70112
2026-03-28 07:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be89717b-7dea-5a92-8ea6-c7ac9869a7f6 with scrape type 2
2026-03-28 07:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be89717b-7dea-5a92-8ea6-c7ac9869a7f6 with scrape type 2
2026-03-28 07:34:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be89717b-7dea-5a92-8ea6-c7ac9869a7f6, identifier: GY70112
2026-03-28 07:34:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be89717b-7dea-5a92-8ea6-c7ac9869a7f6 with identifier: GY70112
2026-03-28 07:34:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be89717b-7dea-5a92-8ea6-c7ac9869a7f6 with identifier: GY70112
2026-03-28 07:34:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be89717b-7dea-5a92-8ea6-c7ac9869a7f6 with identifier: GY70112 to the API
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 155,
'expiration_date': '2026-03-28T17:00:00Z',
'fuel_type': 'petrol',
'id': 'be89717b-7dea-5a92-8ea6-c7ac9869a7f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY70112',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 93221,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-29',
'seller_name': None,
'title': 'Peugeot 308 1.6 THP Roland Garros',
'transmission': 'manual',
'trim': 'Roland Garros',
'year': 2013}
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY70112%27 HTTP/1.1" 200 None
2026-03-28 07:34:51 [auto1.de] INFO: Saving data for GY70112: {'auction_closing_time': 1774717200.0, 'created_time': 1774034374.878897, 'last_price_update_time': 1774683291.530998}
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY70112') HTTP/1.1" 204 0
2026-03-28 07:34:51 [auto1.de] INFO: Found listing with ID: LP56741
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP56741%27 HTTP/1.1" 200 None
2026-03-28 07:34:51 [auto1.de] INFO: Scrape type for LP56741: 0
2026-03-28 07:34:51 [auto1.de] INFO: Found listing with ID: HD75435
2026-03-28 07:34:51 [auto1.de] INFO: Found listing with ID: BG54710
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG54710%27 HTTP/1.1" 200 None
2026-03-28 07:34:51 [auto1.de] INFO: Scrape type for BG54710: 0
2026-03-28 07:34:51 [auto1.de] INFO: Found listing with ID: LD06025
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD06025%27 HTTP/1.1" 200 None
2026-03-28 07:34:51 [auto1.de] INFO: Scrape type for LD06025: 0
2026-03-28 07:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:34:52 [auto1.de] INFO: Channel: 24h | Page: 47 | totalHits: 9252 | hits on page: 40
2026-03-28 07:34:52 [auto1.de] INFO: Found listing with ID: YF10797
2026-03-28 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF10797%27 HTTP/1.1" 200 None
2026-03-28 07:34:52 [auto1.de] INFO: Scrape type for YF10797: 2
2026-03-28 07:34:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 257674fc-f3bf-5f43-b801-4c8043c4f492 with identifier: YF10797
2026-03-28 07:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 257674fc-f3bf-5f43-b801-4c8043c4f492 with scrape type 2
2026-03-28 07:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 257674fc-f3bf-5f43-b801-4c8043c4f492 with scrape type 2
2026-03-28 07:34:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 257674fc-f3bf-5f43-b801-4c8043c4f492, identifier: YF10797
2026-03-28 07:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 257674fc-f3bf-5f43-b801-4c8043c4f492 with identifier: YF10797
2026-03-28 07:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 257674fc-f3bf-5f43-b801-4c8043c4f492 with identifier: YF10797
2026-03-28 07:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 257674fc-f3bf-5f43-b801-4c8043c4f492 with identifier: YF10797 to the API
2026-03-28 07:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:44:14Z',
'fuel_type': 'diesel',
'id': '257674fc-f3bf-5f43-b801-4c8043c4f492',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF10797',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 280837,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-04',
'seller_name': None,
'title': 'Ford Focus 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2016}
2026-03-28 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF10797%27 HTTP/1.1" 200 None
2026-03-28 07:34:52 [auto1.de] INFO: Saving data for YF10797: {'auction_closing_time': 1774716254.0, 'created_time': 1774503052.85372, 'last_price_update_time': 1774683292.899415}
2026-03-28 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF10797') HTTP/1.1" 204 0
2026-03-28 07:34:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:34:52 [auto1.de] INFO: Found listing with ID: ZF08436
2026-03-28 07:34:52 [auto1.de] INFO: Found listing with ID: ZK63444
2026-03-28 07:34:52 [auto1.de] INFO: Found listing with ID: VZ53815
2026-03-28 07:34:52 [auto1.de] INFO: Found listing with ID: VX88052
2026-03-28 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX88052%27 HTTP/1.1" 200 None
2026-03-28 07:34:52 [auto1.de] INFO: Scrape type for VX88052: 2
2026-03-28 07:34:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1766771-f278-5774-9666-14baf2ae82ca with identifier: VX88052
2026-03-28 07:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1766771-f278-5774-9666-14baf2ae82ca with scrape type 2
2026-03-28 07:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1766771-f278-5774-9666-14baf2ae82ca with scrape type 2
2026-03-28 07:34:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1766771-f278-5774-9666-14baf2ae82ca, identifier: VX88052
2026-03-28 07:34:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1766771-f278-5774-9666-14baf2ae82ca with identifier: VX88052
2026-03-28 07:34:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1766771-f278-5774-9666-14baf2ae82ca with identifier: VX88052
2026-03-28 07:34:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1766771-f278-5774-9666-14baf2ae82ca with identifier: VX88052 to the API
2026-03-28 07:34:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 340,
'expiration_date': '2026-03-28T16:54:10Z',
'fuel_type': 'diesel',
'id': 'd1766771-f278-5774-9666-14baf2ae82ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX88052',
'listing': 'auction',
'make': 'BMW',
'model': 'X4',
'odometer': 108294,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-07',
'seller_name': None,
'title': 'BMW X4 M40d Mild-Hybrid',
'transmission': 'automatic',
'trim': '',
'year': 2021}
2026-03-28 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX88052%27 HTTP/1.1" 200 None
2026-03-28 07:34:53 [auto1.de] INFO: Saving data for VX88052: {'auction_closing_time': 1774716850.0, 'created_time': 1773859689.762694, 'last_price_update_time': 1774683293.357881}
2026-03-28 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX88052') HTTP/1.1" 204 0
2026-03-28 07:34:53 [auto1.de] INFO: Found listing with ID: KZ16739
2026-03-28 07:34:53 [auto1.de] INFO: Found listing with ID: EE36911
2026-03-28 07:34:53 [auto1.de] INFO: Found listing with ID: SS03319
2026-03-28 07:34:53 [auto1.de] INFO: Found listing with ID: YW70204
2026-03-28 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW70204%27 HTTP/1.1" 200 None
2026-03-28 07:34:53 [auto1.de] INFO: Scrape type for YW70204: 0
2026-03-28 07:34:53 [auto1.de] INFO: Found listing with ID: FD80734
2026-03-28 07:34:53 [auto1.de] INFO: Found listing with ID: AJ08508
2026-03-28 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ08508%27 HTTP/1.1" 200 None
2026-03-28 07:34:53 [auto1.de] INFO: Scrape type for AJ08508: 0
2026-03-28 07:34:53 [auto1.de] INFO: Found listing with ID: UH98030
2026-03-28 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH98030%27 HTTP/1.1" 200 None
2026-03-28 07:34:53 [auto1.de] INFO: Scrape type for UH98030: 2
2026-03-28 07:34:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4376a6e4-abde-5708-a626-d235308d4961 with identifier: UH98030
2026-03-28 07:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4376a6e4-abde-5708-a626-d235308d4961 with scrape type 2
2026-03-28 07:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4376a6e4-abde-5708-a626-d235308d4961 with scrape type 2
2026-03-28 07:34:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4376a6e4-abde-5708-a626-d235308d4961, identifier: UH98030
2026-03-28 07:34:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4376a6e4-abde-5708-a626-d235308d4961 with identifier: UH98030
2026-03-28 07:34:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4376a6e4-abde-5708-a626-d235308d4961 with identifier: UH98030
2026-03-28 07:34:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4376a6e4-abde-5708-a626-d235308d4961 with identifier: UH98030 to the API
2026-03-28 07:34:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:56:23Z',
'fuel_type': 'diesel',
'id': '4376a6e4-abde-5708-a626-d235308d4961',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH98030',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 201849,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-27',
'seller_name': None,
'title': 'BMW 2er 220d Gran Tourer xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2015}
2026-03-28 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH98030%27 HTTP/1.1" 200 None
2026-03-28 07:34:53 [auto1.de] INFO: Saving data for UH98030: {'auction_closing_time': 1774716983.0, 'created_time': 1773859366.281085, 'last_price_update_time': 1774683293.832643}
2026-03-28 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH98030') HTTP/1.1" 204 0
2026-03-28 07:34:53 [auto1.de] INFO: Found listing with ID: BS27408
2026-03-28 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS27408%27 HTTP/1.1" 200 None
2026-03-28 07:34:53 [auto1.de] INFO: Scrape type for BS27408: 0
2026-03-28 07:34:53 [auto1.de] INFO: Found listing with ID: VX44094
2026-03-28 07:34:53 [auto1.de] INFO: Found listing with ID: AC92366
2026-03-28 07:34:53 [auto1.de] INFO: Found listing with ID: ZU01908
2026-03-28 07:34:53 [auto1.de] INFO: Found listing with ID: XV69460
2026-03-28 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV69460%27 HTTP/1.1" 200 None
2026-03-28 07:34:53 [auto1.de] INFO: Scrape type for XV69460: 0
2026-03-28 07:34:53 [auto1.de] INFO: Found listing with ID: LW52263
2026-03-28 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW52263%27 HTTP/1.1" 200 None
2026-03-28 07:34:53 [auto1.de] INFO: Scrape type for LW52263: 2
2026-03-28 07:34:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0e583c9-9d5c-5f37-8a98-66a821eeb6ad with identifier: LW52263
2026-03-28 07:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0e583c9-9d5c-5f37-8a98-66a821eeb6ad with scrape type 2
2026-03-28 07:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0e583c9-9d5c-5f37-8a98-66a821eeb6ad with scrape type 2
2026-03-28 07:34:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0e583c9-9d5c-5f37-8a98-66a821eeb6ad, identifier: LW52263
2026-03-28 07:34:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0e583c9-9d5c-5f37-8a98-66a821eeb6ad with identifier: LW52263
2026-03-28 07:34:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0e583c9-9d5c-5f37-8a98-66a821eeb6ad with identifier: LW52263
2026-03-28 07:34:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0e583c9-9d5c-5f37-8a98-66a821eeb6ad with identifier: LW52263 to the API
2026-03-28 07:34:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:32:41Z',
'fuel_type': 'petrol',
'id': 'e0e583c9-9d5c-5f37-8a98-66a821eeb6ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW52263',
'listing': 'auction',
'make': 'Saab',
'model': '9-3',
'odometer': 315130,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-02-28',
'seller_name': None,
'title': 'Saab 9-3 2.0 T Vector',
'transmission': 'automatic',
'trim': 'T Vector',
'year': 2006}
2026-03-28 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW52263%27 HTTP/1.1" 200 None
2026-03-28 07:34:54 [auto1.de] INFO: Saving data for LW52263: {'auction_closing_time': 1774715561.0, 'created_time': 1774466250.751272, 'last_price_update_time': 1774683294.388455}
2026-03-28 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW52263') HTTP/1.1" 204 0
2026-03-28 07:34:54 [auto1.de] INFO: Found listing with ID: MZ37789
2026-03-28 07:34:54 [auto1.de] INFO: Found listing with ID: ER58682
2026-03-28 07:34:54 [auto1.de] INFO: Found listing with ID: CV14435
2026-03-28 07:34:54 [auto1.de] INFO: Found listing with ID: WW27642
2026-03-28 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW27642%27 HTTP/1.1" 200 None
2026-03-28 07:34:54 [auto1.de] INFO: Scrape type for WW27642: 0
2026-03-28 07:34:54 [auto1.de] INFO: Found listing with ID: BZ25882
2026-03-28 07:34:54 [auto1.de] INFO: Found listing with ID: DA66634
2026-03-28 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA66634%27 HTTP/1.1" 200 None
2026-03-28 07:34:54 [auto1.de] INFO: Scrape type for DA66634: 0
2026-03-28 07:34:54 [auto1.de] INFO: Found listing with ID: LK13966
2026-03-28 07:34:54 [auto1.de] INFO: Found listing with ID: UM70587
2026-03-28 07:34:54 [auto1.de] INFO: Found listing with ID: UM02167
2026-03-28 07:34:54 [auto1.de] INFO: Found listing with ID: BN03285
2026-03-28 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN03285%27 HTTP/1.1" 200 None
2026-03-28 07:34:54 [auto1.de] INFO: Scrape type for BN03285: 0
2026-03-28 07:34:54 [auto1.de] INFO: Found listing with ID: SX00358
2026-03-28 07:34:54 [auto1.de] INFO: Found listing with ID: FT33295
2026-03-28 07:34:54 [auto1.de] INFO: Found listing with ID: HC21911
2026-03-28 07:34:54 [auto1.de] INFO: Found listing with ID: RX96869
2026-03-28 07:34:54 [auto1.de] INFO: Found listing with ID: KM84276
2026-03-28 07:34:54 [auto1.de] INFO: Found listing with ID: PP83297
2026-03-28 07:34:54 [auto1.de] INFO: Found listing with ID: PB88478
2026-03-28 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB88478%27 HTTP/1.1" 200 None
2026-03-28 07:34:54 [auto1.de] INFO: Scrape type for PB88478: 0
2026-03-28 07:34:54 [auto1.de] INFO: Found listing with ID: UU13663
2026-03-28 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU13663%27 HTTP/1.1" 200 None
2026-03-28 07:34:54 [auto1.de] INFO: Scrape type for UU13663: 0
2026-03-28 07:34:54 [auto1.de] INFO: Found listing with ID: ZD70727
2026-03-28 07:34:54 [auto1.de] INFO: Found listing with ID: WA83866
2026-03-28 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA83866%27 HTTP/1.1" 200 None
2026-03-28 07:34:54 [auto1.de] INFO: Scrape type for WA83866: 2
2026-03-28 07:34:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de119fe3-88cc-50c4-8aa7-f587711375a5 with identifier: WA83866
2026-03-28 07:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de119fe3-88cc-50c4-8aa7-f587711375a5 with scrape type 2
2026-03-28 07:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de119fe3-88cc-50c4-8aa7-f587711375a5 with scrape type 2
2026-03-28 07:34:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de119fe3-88cc-50c4-8aa7-f587711375a5, identifier: WA83866
2026-03-28 07:34:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de119fe3-88cc-50c4-8aa7-f587711375a5 with identifier: WA83866
2026-03-28 07:34:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de119fe3-88cc-50c4-8aa7-f587711375a5 with identifier: WA83866
2026-03-28 07:34:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de119fe3-88cc-50c4-8aa7-f587711375a5 with identifier: WA83866 to the API
2026-03-28 07:34:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:06:51Z',
'fuel_type': 'petrol',
'id': 'de119fe3-88cc-50c4-8aa7-f587711375a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA83866',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Cactus',
'odometer': 143006,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-26',
'seller_name': None,
'title': 'Citroen C4 Cactus 1.2 PureTech Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2019}
2026-03-28 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA83866%27 HTTP/1.1" 200 None
2026-03-28 07:34:54 [auto1.de] INFO: Saving data for WA83866: {'auction_closing_time': 1774714011.0, 'created_time': 1774466984.235692, 'last_price_update_time': 1774683294.899825}
2026-03-28 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA83866') HTTP/1.1" 204 0
2026-03-28 07:34:55 [auto1.de] INFO: Found listing with ID: HH92077
2026-03-28 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH92077%27 HTTP/1.1" 200 None
2026-03-28 07:34:55 [auto1.de] INFO: Scrape type for HH92077: 2
2026-03-28 07:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77ac1364-3a3e-5ca9-80f8-f4ec3daa6c36 with identifier: HH92077
2026-03-28 07:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77ac1364-3a3e-5ca9-80f8-f4ec3daa6c36 with scrape type 2
2026-03-28 07:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77ac1364-3a3e-5ca9-80f8-f4ec3daa6c36 with scrape type 2
2026-03-28 07:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77ac1364-3a3e-5ca9-80f8-f4ec3daa6c36, identifier: HH92077
2026-03-28 07:34:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77ac1364-3a3e-5ca9-80f8-f4ec3daa6c36 with identifier: HH92077
2026-03-28 07:34:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77ac1364-3a3e-5ca9-80f8-f4ec3daa6c36 with identifier: HH92077
2026-03-28 07:34:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77ac1364-3a3e-5ca9-80f8-f4ec3daa6c36 with identifier: HH92077 to the API
2026-03-28 07:34:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:25:32Z',
'fuel_type': 'diesel',
'id': '77ac1364-3a3e-5ca9-80f8-f4ec3daa6c36',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH92077',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 97880,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-30',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI SportLine',
'transmission': 'automatic',
'trim': 'SportLine',
'year': 2019}
2026-03-28 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH92077%27 HTTP/1.1" 200 None
2026-03-28 07:34:55 [auto1.de] INFO: Saving data for HH92077: {'auction_closing_time': 1774715132.0, 'created_time': 1774464417.016101, 'last_price_update_time': 1774683295.413231}
2026-03-28 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH92077') HTTP/1.1" 204 0
2026-03-28 07:34:55 [auto1.de] INFO: Found listing with ID: SB35470
2026-03-28 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB35470%27 HTTP/1.1" 200 None
2026-03-28 07:34:55 [auto1.de] INFO: Scrape type for SB35470: 0
2026-03-28 07:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:34:55 [auto1.de] INFO: Channel: 24h | Page: 48 | totalHits: 9252 | hits on page: 40
2026-03-28 07:34:55 [auto1.de] INFO: Found listing with ID: YW60751
2026-03-28 07:34:55 [auto1.de] INFO: Found listing with ID: SK20956
2026-03-28 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK20956%27 HTTP/1.1" 200 None
2026-03-28 07:34:55 [auto1.de] INFO: Scrape type for SK20956: 0
2026-03-28 07:34:55 [auto1.de] INFO: Found listing with ID: YX62865
2026-03-28 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX62865%27 HTTP/1.1" 200 None
2026-03-28 07:34:55 [auto1.de] INFO: Scrape type for YX62865: 0
2026-03-28 07:34:55 [auto1.de] INFO: Found listing with ID: WR55651
2026-03-28 07:34:55 [auto1.de] INFO: Found listing with ID: ZZ55407
2026-03-28 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ55407%27 HTTP/1.1" 200 None
2026-03-28 07:34:55 [auto1.de] INFO: Scrape type for ZZ55407: 0
2026-03-28 07:34:55 [auto1.de] INFO: Found listing with ID: HU93536
2026-03-28 07:34:55 [auto1.de] INFO: Found listing with ID: JL97889
2026-03-28 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL97889%27 HTTP/1.1" 200 None
2026-03-28 07:34:56 [auto1.de] INFO: Scrape type for JL97889: 2
2026-03-28 07:34:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc4144b9-9a8d-55ce-9708-323fcadaf0f8 with identifier: JL97889
2026-03-28 07:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc4144b9-9a8d-55ce-9708-323fcadaf0f8 with scrape type 2
2026-03-28 07:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc4144b9-9a8d-55ce-9708-323fcadaf0f8 with scrape type 2
2026-03-28 07:34:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc4144b9-9a8d-55ce-9708-323fcadaf0f8, identifier: JL97889
2026-03-28 07:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc4144b9-9a8d-55ce-9708-323fcadaf0f8 with identifier: JL97889
2026-03-28 07:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc4144b9-9a8d-55ce-9708-323fcadaf0f8 with identifier: JL97889
2026-03-28 07:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc4144b9-9a8d-55ce-9708-323fcadaf0f8 with identifier: JL97889 to the API
2026-03-28 07:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:20:21Z',
'fuel_type': 'diesel',
'id': 'cc4144b9-9a8d-55ce-9708-323fcadaf0f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL97889',
'listing': 'auction',
'make': 'Mazda',
'model': '6',
'odometer': 158017,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-20',
'seller_name': None,
'title': 'Mazda 6 2.2 Turbodiesel Kizoku',
'transmission': 'automatic',
'trim': 'Kizoku',
'year': 2017}
2026-03-28 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL97889%27 HTTP/1.1" 200 None
2026-03-28 07:34:56 [auto1.de] INFO: Saving data for JL97889: {'auction_closing_time': 1774714821.0, 'created_time': 1774034352.451435, 'last_price_update_time': 1774683296.473783}
2026-03-28 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL97889') HTTP/1.1" 204 0
2026-03-28 07:34:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:34:56 [auto1.de] INFO: Found listing with ID: EZ47162
2026-03-28 07:34:56 [auto1.de] INFO: Found listing with ID: YU02845
2026-03-28 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU02845%27 HTTP/1.1" 200 None
2026-03-28 07:34:56 [auto1.de] INFO: Scrape type for YU02845: 0
2026-03-28 07:34:56 [auto1.de] INFO: Found listing with ID: CP99772
2026-03-28 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP99772%27 HTTP/1.1" 200 None
2026-03-28 07:34:56 [auto1.de] INFO: Scrape type for CP99772: 0
2026-03-28 07:34:56 [auto1.de] INFO: Found listing with ID: WR22738
2026-03-28 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR22738%27 HTTP/1.1" 200 None
2026-03-28 07:34:56 [auto1.de] INFO: Scrape type for WR22738: 0
2026-03-28 07:34:56 [auto1.de] INFO: Found listing with ID: GP74205
2026-03-28 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP74205%27 HTTP/1.1" 200 None
2026-03-28 07:34:56 [auto1.de] INFO: Scrape type for GP74205: 2
2026-03-28 07:34:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e68f639e-5788-54b4-ac17-9520c97d2e56 with identifier: GP74205
2026-03-28 07:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e68f639e-5788-54b4-ac17-9520c97d2e56 with scrape type 2
2026-03-28 07:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e68f639e-5788-54b4-ac17-9520c97d2e56 with scrape type 2
2026-03-28 07:34:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e68f639e-5788-54b4-ac17-9520c97d2e56, identifier: GP74205
2026-03-28 07:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e68f639e-5788-54b4-ac17-9520c97d2e56 with identifier: GP74205
2026-03-28 07:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e68f639e-5788-54b4-ac17-9520c97d2e56 with identifier: GP74205
2026-03-28 07:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e68f639e-5788-54b4-ac17-9520c97d2e56 with identifier: GP74205 to the API
2026-03-28 07:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:26:04Z',
'fuel_type': 'petrol',
'id': 'e68f639e-5788-54b4-ac17-9520c97d2e56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP74205',
'listing': 'auction',
'make': 'Hyundai',
'model': 'ix35',
'odometer': 164909,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-11',
'seller_name': None,
'title': 'Hyundai ix35 1.6 Classic 2WD',
'transmission': 'manual',
'trim': 'Classic 2WD',
'year': 2013}
2026-03-28 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP74205%27 HTTP/1.1" 200 None
2026-03-28 07:34:56 [auto1.de] INFO: Saving data for GP74205: {'auction_closing_time': 1774715164.0, 'created_time': 1774467921.76104, 'last_price_update_time': 1774683296.947575}
2026-03-28 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GP74205') HTTP/1.1" 204 0
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: VM58526
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM58526%27 HTTP/1.1" 200 None
2026-03-28 07:34:57 [auto1.de] INFO: Scrape type for VM58526: 0
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: BB20772
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: AN54197
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN54197%27 HTTP/1.1" 200 None
2026-03-28 07:34:57 [auto1.de] INFO: Scrape type for AN54197: 0
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: VM18539
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM18539%27 HTTP/1.1" 200 None
2026-03-28 07:34:57 [auto1.de] INFO: Scrape type for VM18539: 2
2026-03-28 07:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6c432be-73f1-5958-be5c-eb5150f2349d with identifier: VM18539
2026-03-28 07:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6c432be-73f1-5958-be5c-eb5150f2349d with scrape type 2
2026-03-28 07:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6c432be-73f1-5958-be5c-eb5150f2349d with scrape type 2
2026-03-28 07:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6c432be-73f1-5958-be5c-eb5150f2349d, identifier: VM18539
2026-03-28 07:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6c432be-73f1-5958-be5c-eb5150f2349d with identifier: VM18539
2026-03-28 07:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6c432be-73f1-5958-be5c-eb5150f2349d with identifier: VM18539
2026-03-28 07:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6c432be-73f1-5958-be5c-eb5150f2349d with identifier: VM18539 to the API
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:00:22Z',
'fuel_type': 'petrol',
'id': 'd6c432be-73f1-5958-be5c-eb5150f2349d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM18539',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 139480,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-08-31',
'seller_name': None,
'title': 'Skoda Fabia 1.4 Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2008}
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM18539%27 HTTP/1.1" 200 None
2026-03-28 07:34:57 [auto1.de] INFO: Saving data for VM18539: {'auction_closing_time': 1774713622.0, 'created_time': 1774464185.457812, 'last_price_update_time': 1774683297.502326}
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VM18539') HTTP/1.1" 204 0
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: XS27147
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: EC94378
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: YZ02891
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: KG33917
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG33917%27 HTTP/1.1" 200 None
2026-03-28 07:34:57 [auto1.de] INFO: Scrape type for KG33917: 0
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: SR59541
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR59541%27 HTTP/1.1" 200 None
2026-03-28 07:34:57 [auto1.de] INFO: Scrape type for SR59541: 0
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: XH17587
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: GC49390
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC49390%27 HTTP/1.1" 200 None
2026-03-28 07:34:57 [auto1.de] INFO: Scrape type for GC49390: 0
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: LV13893
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: CE86831
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE86831%27 HTTP/1.1" 200 None
2026-03-28 07:34:57 [auto1.de] INFO: Scrape type for CE86831: 0
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: WV53584
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV53584%27 HTTP/1.1" 200 None
2026-03-28 07:34:57 [auto1.de] INFO: Scrape type for WV53584: 0
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: ZE28536
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: TW48266
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: VD19209
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: LB34489
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: LK66468
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK66468%27 HTTP/1.1" 200 None
2026-03-28 07:34:57 [auto1.de] INFO: Scrape type for LK66468: 0
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: FZ98450
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: TR39575
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR39575%27 HTTP/1.1" 200 None
2026-03-28 07:34:57 [auto1.de] INFO: Scrape type for TR39575: 0
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: KN16725
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN16725%27 HTTP/1.1" 200 None
2026-03-28 07:34:57 [auto1.de] INFO: Scrape type for KN16725: 0
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: VG22858
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: ZK19786
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK19786%27 HTTP/1.1" 200 None
2026-03-28 07:34:57 [auto1.de] INFO: Scrape type for ZK19786: 0
2026-03-28 07:34:57 [auto1.de] INFO: Found listing with ID: SA90137
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA90137%27 HTTP/1.1" 200 None
2026-03-28 07:34:57 [auto1.de] INFO: Scrape type for SA90137: 2
2026-03-28 07:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c468a05-220f-5413-8d7c-81e550e0e6c5 with identifier: SA90137
2026-03-28 07:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c468a05-220f-5413-8d7c-81e550e0e6c5 with scrape type 2
2026-03-28 07:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c468a05-220f-5413-8d7c-81e550e0e6c5 with scrape type 2
2026-03-28 07:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c468a05-220f-5413-8d7c-81e550e0e6c5, identifier: SA90137
2026-03-28 07:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c468a05-220f-5413-8d7c-81e550e0e6c5 with identifier: SA90137
2026-03-28 07:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c468a05-220f-5413-8d7c-81e550e0e6c5 with identifier: SA90137
2026-03-28 07:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c468a05-220f-5413-8d7c-81e550e0e6c5 with identifier: SA90137 to the API
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:05:56Z',
'fuel_type': 'petrol',
'id': '6c468a05-220f-5413-8d7c-81e550e0e6c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA90137',
'listing': 'auction',
'make': 'Kia',
'model': 'Picanto',
'odometer': 44129,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-04-16',
'seller_name': None,
'title': 'Kia Picanto 1.0 TGDI GT Line',
'transmission': 'manual',
'trim': 'GT Line',
'year': 2020}
2026-03-28 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA90137%27 HTTP/1.1" 200 None
2026-03-28 07:34:58 [auto1.de] INFO: Saving data for SA90137: {'auction_closing_time': 1774713956.0, 'created_time': 1774466743.796276, 'last_price_update_time': 1774683298.091944}
2026-03-28 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA90137') HTTP/1.1" 204 0
2026-03-28 07:34:58 [auto1.de] INFO: Found listing with ID: JM85963
2026-03-28 07:34:58 [auto1.de] INFO: Found listing with ID: EW45766
2026-03-28 07:34:58 [auto1.de] INFO: Found listing with ID: WH66881
2026-03-28 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH66881%27 HTTP/1.1" 200 None
2026-03-28 07:34:58 [auto1.de] INFO: Scrape type for WH66881: 0
2026-03-28 07:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:34:59 [auto1.de] INFO: Channel: 24h | Page: 49 | totalHits: 9252 | hits on page: 40
2026-03-28 07:34:59 [auto1.de] INFO: Found listing with ID: LC48893
2026-03-28 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC48893%27 HTTP/1.1" 200 None
2026-03-28 07:34:59 [auto1.de] INFO: Scrape type for LC48893: 2
2026-03-28 07:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5a84564-7301-5ce0-87fd-5a1949cf7935 with identifier: LC48893
2026-03-28 07:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5a84564-7301-5ce0-87fd-5a1949cf7935 with scrape type 2
2026-03-28 07:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5a84564-7301-5ce0-87fd-5a1949cf7935 with scrape type 2
2026-03-28 07:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5a84564-7301-5ce0-87fd-5a1949cf7935, identifier: LC48893
2026-03-28 07:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5a84564-7301-5ce0-87fd-5a1949cf7935 with identifier: LC48893
2026-03-28 07:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5a84564-7301-5ce0-87fd-5a1949cf7935 with identifier: LC48893
2026-03-28 07:34:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5a84564-7301-5ce0-87fd-5a1949cf7935 with identifier: LC48893 to the API
2026-03-28 07:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:06:45Z',
'fuel_type': 'diesel',
'id': 'b5a84564-7301-5ce0-87fd-5a1949cf7935',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC48893',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 170688,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-16',
'seller_name': None,
'title': 'BMW X1 sDrive 20d',
'transmission': 'manual',
'trim': '',
'year': 2015}
2026-03-28 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC48893%27 HTTP/1.1" 200 None
2026-03-28 07:34:59 [auto1.de] INFO: Saving data for LC48893: {'auction_closing_time': 1774714005.0, 'created_time': 1774465841.395202, 'last_price_update_time': 1774683299.590007}
2026-03-28 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC48893') HTTP/1.1" 204 0
2026-03-28 07:34:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:34:59 [auto1.de] INFO: Found listing with ID: SD14498
2026-03-28 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD14498%27 HTTP/1.1" 200 None
2026-03-28 07:34:59 [auto1.de] INFO: Scrape type for SD14498: 0
2026-03-28 07:34:59 [auto1.de] INFO: Found listing with ID: KP50687
2026-03-28 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP50687%27 HTTP/1.1" 200 None
2026-03-28 07:34:59 [auto1.de] INFO: Scrape type for KP50687: 0
2026-03-28 07:34:59 [auto1.de] INFO: Found listing with ID: MG33600
2026-03-28 07:34:59 [auto1.de] INFO: Found listing with ID: LS78763
2026-03-28 07:34:59 [auto1.de] INFO: Found listing with ID: MU83359
2026-03-28 07:34:59 [auto1.de] INFO: Found listing with ID: JD54519
2026-03-28 07:34:59 [auto1.de] INFO: Found listing with ID: AR17356
2026-03-28 07:34:59 [auto1.de] INFO: Found listing with ID: NS95449
2026-03-28 07:34:59 [auto1.de] INFO: Found listing with ID: SP79690
2026-03-28 07:34:59 [auto1.de] INFO: Found listing with ID: JP42070
2026-03-28 07:34:59 [auto1.de] INFO: Found listing with ID: UC38867
2026-03-28 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC38867%27 HTTP/1.1" 200 None
2026-03-28 07:34:59 [auto1.de] INFO: Scrape type for UC38867: 0
2026-03-28 07:34:59 [auto1.de] INFO: Found listing with ID: ZT89563
2026-03-28 07:34:59 [auto1.de] INFO: Found listing with ID: ET23804
2026-03-28 07:34:59 [auto1.de] INFO: Found listing with ID: BN99234
2026-03-28 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN99234%27 HTTP/1.1" 200 None
2026-03-28 07:34:59 [auto1.de] INFO: Scrape type for BN99234: 0
2026-03-28 07:34:59 [auto1.de] INFO: Found listing with ID: ND35935
2026-03-28 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND35935%27 HTTP/1.1" 200 None
2026-03-28 07:34:59 [auto1.de] INFO: Scrape type for ND35935: 2
2026-03-28 07:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cce2bcd0-b987-5a99-9176-b8215ece91e0 with identifier: ND35935
2026-03-28 07:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cce2bcd0-b987-5a99-9176-b8215ece91e0 with scrape type 2
2026-03-28 07:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cce2bcd0-b987-5a99-9176-b8215ece91e0 with scrape type 2
2026-03-28 07:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cce2bcd0-b987-5a99-9176-b8215ece91e0, identifier: ND35935
2026-03-28 07:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cce2bcd0-b987-5a99-9176-b8215ece91e0 with identifier: ND35935
2026-03-28 07:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cce2bcd0-b987-5a99-9176-b8215ece91e0 with identifier: ND35935
2026-03-28 07:34:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cce2bcd0-b987-5a99-9176-b8215ece91e0 with identifier: ND35935 to the API
2026-03-28 07:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:34:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 275,
'expiration_date': '2026-03-28T16:24:59Z',
'fuel_type': 'diesel',
'id': 'cce2bcd0-b987-5a99-9176-b8215ece91e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND35935',
'listing': 'auction',
'make': 'Jaguar',
'model': 'XF',
'odometer': 107273,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-09',
'seller_name': None,
'title': 'Jaguar XF 3.0 D V6 S Portfolio',
'transmission': 'automatic',
'trim': 'S Portfolio',
'year': 2010}
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND35935%27 HTTP/1.1" 200 None
2026-03-28 07:35:00 [auto1.de] INFO: Saving data for ND35935: {'auction_closing_time': 1774715099.0, 'created_time': 1772545135.017775, 'last_price_update_time': 1774683300.128985}
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND35935') HTTP/1.1" 204 0
2026-03-28 07:35:00 [auto1.de] INFO: Found listing with ID: AY72100
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY72100%27 HTTP/1.1" 200 None
2026-03-28 07:35:00 [auto1.de] INFO: Scrape type for AY72100: 0
2026-03-28 07:35:00 [auto1.de] INFO: Found listing with ID: ZA57423
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA57423%27 HTTP/1.1" 200 None
2026-03-28 07:35:00 [auto1.de] INFO: Scrape type for ZA57423: 2
2026-03-28 07:35:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 303511c1-b262-5022-a16e-2065f9b515c5 with identifier: ZA57423
2026-03-28 07:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 303511c1-b262-5022-a16e-2065f9b515c5 with scrape type 2
2026-03-28 07:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 303511c1-b262-5022-a16e-2065f9b515c5 with scrape type 2
2026-03-28 07:35:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 303511c1-b262-5022-a16e-2065f9b515c5, identifier: ZA57423
2026-03-28 07:35:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 303511c1-b262-5022-a16e-2065f9b515c5 with identifier: ZA57423
2026-03-28 07:35:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 303511c1-b262-5022-a16e-2065f9b515c5 with identifier: ZA57423
2026-03-28 07:35:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 303511c1-b262-5022-a16e-2065f9b515c5 with identifier: ZA57423 to the API
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:01:48Z',
'fuel_type': 'petrol',
'id': '303511c1-b262-5022-a16e-2065f9b515c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA57423',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 39629,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-10',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.4 TSI Team',
'transmission': 'manual',
'trim': 'Team',
'year': 2011}
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA57423%27 HTTP/1.1" 200 None
2026-03-28 07:35:00 [auto1.de] INFO: Saving data for ZA57423: {'auction_closing_time': 1774713708.0, 'created_time': 1774466819.866192, 'last_price_update_time': 1774683300.688515}
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA57423') HTTP/1.1" 204 0
2026-03-28 07:35:00 [auto1.de] INFO: Found listing with ID: WJ35504
2026-03-28 07:35:00 [auto1.de] INFO: Found listing with ID: JB09111
2026-03-28 07:35:00 [auto1.de] INFO: Found listing with ID: PG10773
2026-03-28 07:35:00 [auto1.de] INFO: Found listing with ID: JH61376
2026-03-28 07:35:00 [auto1.de] INFO: Found listing with ID: UH76939
2026-03-28 07:35:00 [auto1.de] INFO: Found listing with ID: LS56228
2026-03-28 07:35:00 [auto1.de] INFO: Found listing with ID: VS98384
2026-03-28 07:35:00 [auto1.de] INFO: Found listing with ID: TB55378
2026-03-28 07:35:00 [auto1.de] INFO: Found listing with ID: FF11378
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF11378%27 HTTP/1.1" 200 None
2026-03-28 07:35:00 [auto1.de] INFO: Scrape type for FF11378: 0
2026-03-28 07:35:00 [auto1.de] INFO: Found listing with ID: AP01052
2026-03-28 07:35:00 [auto1.de] INFO: Found listing with ID: UF45405
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF45405%27 HTTP/1.1" 200 None
2026-03-28 07:35:00 [auto1.de] INFO: Scrape type for UF45405: 0
2026-03-28 07:35:00 [auto1.de] INFO: Found listing with ID: WS02487
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02487%27 HTTP/1.1" 200 None
2026-03-28 07:35:00 [auto1.de] INFO: Scrape type for WS02487: 0
2026-03-28 07:35:00 [auto1.de] INFO: Found listing with ID: XR03491
2026-03-28 07:35:00 [auto1.de] INFO: Found listing with ID: MA63217
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA63217%27 HTTP/1.1" 200 None
2026-03-28 07:35:00 [auto1.de] INFO: Scrape type for MA63217: 0
2026-03-28 07:35:00 [auto1.de] INFO: Found listing with ID: XM77164
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM77164%27 HTTP/1.1" 200 None
2026-03-28 07:35:00 [auto1.de] INFO: Scrape type for XM77164: 0
2026-03-28 07:35:00 [auto1.de] INFO: Found listing with ID: HH56316
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH56316%27 HTTP/1.1" 200 None
2026-03-28 07:35:00 [auto1.de] INFO: Scrape type for HH56316: 0
2026-03-28 07:35:00 [auto1.de] INFO: Found listing with ID: UE89498
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE89498%27 HTTP/1.1" 200 None
2026-03-28 07:35:00 [auto1.de] INFO: Scrape type for UE89498: 0
2026-03-28 07:35:00 [auto1.de] INFO: Found listing with ID: JF78286
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF78286%27 HTTP/1.1" 200 None
2026-03-28 07:35:00 [auto1.de] INFO: Scrape type for JF78286: 0
2026-03-28 07:35:00 [auto1.de] INFO: Found listing with ID: JP65265
2026-03-28 07:35:00 [auto1.de] INFO: Found listing with ID: ET53588
2026-03-28 07:35:00 [auto1.de] INFO: Found listing with ID: NP60172
2026-03-28 07:35:00 [auto1.de] INFO: Found listing with ID: TT75700
2026-03-28 07:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:35:01 [auto1.de] INFO: Channel: 24h | Page: 50 | totalHits: 9253 | hits on page: 40
2026-03-28 07:35:01 [auto1.de] INFO: Found listing with ID: TT75700
2026-03-28 07:35:01 [auto1.de] INFO: Found listing with ID: EH96711
2026-03-28 07:35:01 [auto1.de] INFO: Found listing with ID: JP09068
2026-03-28 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP09068%27 HTTP/1.1" 200 None
2026-03-28 07:35:01 [auto1.de] INFO: Scrape type for JP09068: 2
2026-03-28 07:35:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd795217-6360-5b88-87b9-a5cb5ce8313f with identifier: JP09068
2026-03-28 07:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd795217-6360-5b88-87b9-a5cb5ce8313f with scrape type 2
2026-03-28 07:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd795217-6360-5b88-87b9-a5cb5ce8313f with scrape type 2
2026-03-28 07:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd795217-6360-5b88-87b9-a5cb5ce8313f, identifier: JP09068
2026-03-28 07:35:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd795217-6360-5b88-87b9-a5cb5ce8313f with identifier: JP09068
2026-03-28 07:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd795217-6360-5b88-87b9-a5cb5ce8313f with identifier: JP09068
2026-03-28 07:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd795217-6360-5b88-87b9-a5cb5ce8313f with identifier: JP09068 to the API
2026-03-28 07:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:31:39Z',
'fuel_type': 'petrol',
'id': 'cd795217-6360-5b88-87b9-a5cb5ce8313f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP09068',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 105553,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-15',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 CGI BlueEfficiency Elegance',
'transmission': 'automatic',
'trim': 'BlueEfficiency Elegance',
'year': 2010}
2026-03-28 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP09068%27 HTTP/1.1" 200 None
2026-03-28 07:35:01 [auto1.de] INFO: Saving data for JP09068: {'auction_closing_time': 1774715499.0, 'created_time': 1774467368.539992, 'last_price_update_time': 1774683301.904139}
2026-03-28 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP09068') HTTP/1.1" 204 0
2026-03-28 07:35:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:35:02 [auto1.de] INFO: Found listing with ID: HA98993
2026-03-28 07:35:02 [auto1.de] INFO: Found listing with ID: WN68055
2026-03-28 07:35:02 [auto1.de] INFO: Found listing with ID: UA56207
2026-03-28 07:35:02 [auto1.de] INFO: Found listing with ID: DA12198
2026-03-28 07:35:02 [auto1.de] INFO: Found listing with ID: NX98723
2026-03-28 07:35:02 [auto1.de] INFO: Found listing with ID: BN35753
2026-03-28 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN35753%27 HTTP/1.1" 200 None
2026-03-28 07:35:02 [auto1.de] INFO: Scrape type for BN35753: 0
2026-03-28 07:35:02 [auto1.de] INFO: Found listing with ID: MM33078
2026-03-28 07:35:02 [auto1.de] INFO: Found listing with ID: SU92551
2026-03-28 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU92551%27 HTTP/1.1" 200 None
2026-03-28 07:35:02 [auto1.de] INFO: Scrape type for SU92551: 0
2026-03-28 07:35:02 [auto1.de] INFO: Found listing with ID: EG23428
2026-03-28 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG23428%27 HTTP/1.1" 200 None
2026-03-28 07:35:02 [auto1.de] INFO: Scrape type for EG23428: 0
2026-03-28 07:35:02 [auto1.de] INFO: Found listing with ID: JG98331
2026-03-28 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG98331%27 HTTP/1.1" 200 None
2026-03-28 07:35:02 [auto1.de] INFO: Scrape type for JG98331: 0
2026-03-28 07:35:02 [auto1.de] INFO: Found listing with ID: GT81151
2026-03-28 07:35:02 [auto1.de] INFO: Found listing with ID: SW44796
2026-03-28 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW44796%27 HTTP/1.1" 200 None
2026-03-28 07:35:02 [auto1.de] INFO: Scrape type for SW44796: 0
2026-03-28 07:35:02 [auto1.de] INFO: Found listing with ID: DZ63993
2026-03-28 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ63993%27 HTTP/1.1" 200 None
2026-03-28 07:35:02 [auto1.de] INFO: Scrape type for DZ63993: 2
2026-03-28 07:35:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0546b96-c8da-531e-948f-0583fadaef4a with identifier: DZ63993
2026-03-28 07:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0546b96-c8da-531e-948f-0583fadaef4a with scrape type 2
2026-03-28 07:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0546b96-c8da-531e-948f-0583fadaef4a with scrape type 2
2026-03-28 07:35:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0546b96-c8da-531e-948f-0583fadaef4a, identifier: DZ63993
2026-03-28 07:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0546b96-c8da-531e-948f-0583fadaef4a with identifier: DZ63993
2026-03-28 07:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0546b96-c8da-531e-948f-0583fadaef4a with identifier: DZ63993
2026-03-28 07:35:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0546b96-c8da-531e-948f-0583fadaef4a with identifier: DZ63993 to the API
2026-03-28 07:35:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:11:01Z',
'fuel_type': 'diesel',
'id': 'd0546b96-c8da-531e-948f-0583fadaef4a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ63993',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 211414,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-14',
'seller_name': None,
'title': 'Audi A4 2.0 TDI S line Sportpaket plus',
'transmission': 'automatic',
'trim': 'S line Sportpaket plus',
'year': 2015}
2026-03-28 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ63993%27 HTTP/1.1" 200 None
2026-03-28 07:35:02 [auto1.de] INFO: Saving data for DZ63993: {'auction_closing_time': 1774714261.0, 'created_time': 1774468001.291355, 'last_price_update_time': 1774683302.58484}
2026-03-28 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ63993') HTTP/1.1" 204 0
2026-03-28 07:35:02 [auto1.de] INFO: Found listing with ID: AV28159
2026-03-28 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV28159%27 HTTP/1.1" 200 None
2026-03-28 07:35:02 [auto1.de] INFO: Scrape type for AV28159: 0
2026-03-28 07:35:02 [auto1.de] INFO: Found listing with ID: DH11736
2026-03-28 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH11736%27 HTTP/1.1" 200 None
2026-03-28 07:35:02 [auto1.de] INFO: Scrape type for DH11736: 2
2026-03-28 07:35:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b00dda63-695c-599b-96d0-94d7e86edaf6 with identifier: DH11736
2026-03-28 07:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b00dda63-695c-599b-96d0-94d7e86edaf6 with scrape type 2
2026-03-28 07:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b00dda63-695c-599b-96d0-94d7e86edaf6 with scrape type 2
2026-03-28 07:35:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b00dda63-695c-599b-96d0-94d7e86edaf6, identifier: DH11736
2026-03-28 07:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b00dda63-695c-599b-96d0-94d7e86edaf6 with identifier: DH11736
2026-03-28 07:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b00dda63-695c-599b-96d0-94d7e86edaf6 with identifier: DH11736
2026-03-28 07:35:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b00dda63-695c-599b-96d0-94d7e86edaf6 with identifier: DH11736 to the API
2026-03-28 07:35:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:14:30Z',
'fuel_type': 'petrol',
'id': 'b00dda63-695c-599b-96d0-94d7e86edaf6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH11736',
'listing': 'auction',
'make': 'Kia',
'model': 'Rio',
'odometer': 211333,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-07',
'seller_name': None,
'title': 'Kia Rio 1.2 Attract',
'transmission': 'manual',
'trim': 'Attract',
'year': 2012}
2026-03-28 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH11736%27 HTTP/1.1" 200 None
2026-03-28 07:35:03 [auto1.de] INFO: Saving data for DH11736: {'auction_closing_time': 1774714470.0, 'created_time': 1774466143.467, 'last_price_update_time': 1774683303.231684}
2026-03-28 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DH11736') HTTP/1.1" 204 0
2026-03-28 07:35:03 [auto1.de] INFO: Found listing with ID: HB39069
2026-03-28 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB39069%27 HTTP/1.1" 200 None
2026-03-28 07:35:03 [auto1.de] INFO: Scrape type for HB39069: 0
2026-03-28 07:35:03 [auto1.de] INFO: Found listing with ID: FH49394
2026-03-28 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH49394%27 HTTP/1.1" 200 None
2026-03-28 07:35:03 [auto1.de] INFO: Scrape type for FH49394: 2
2026-03-28 07:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 151619dc-df97-50f6-b447-2d42ebaa4cee with identifier: FH49394
2026-03-28 07:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 151619dc-df97-50f6-b447-2d42ebaa4cee with scrape type 2
2026-03-28 07:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 151619dc-df97-50f6-b447-2d42ebaa4cee with scrape type 2
2026-03-28 07:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 151619dc-df97-50f6-b447-2d42ebaa4cee, identifier: FH49394
2026-03-28 07:35:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 151619dc-df97-50f6-b447-2d42ebaa4cee with identifier: FH49394
2026-03-28 07:35:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 151619dc-df97-50f6-b447-2d42ebaa4cee with identifier: FH49394
2026-03-28 07:35:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 151619dc-df97-50f6-b447-2d42ebaa4cee with identifier: FH49394 to the API
2026-03-28 07:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 87,
'expiration_date': '2026-03-28T16:58:03Z',
'fuel_type': 'petrol',
'id': '151619dc-df97-50f6-b447-2d42ebaa4cee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH49394',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 97279,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-12-12',
'seller_name': None,
'title': 'Toyota Yaris 1.3 VVT-i Sol',
'transmission': 'automatic',
'trim': 'Sol',
'year': 2006}
2026-03-28 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH49394%27 HTTP/1.1" 200 None
2026-03-28 07:35:03 [auto1.de] INFO: Saving data for FH49394: {'auction_closing_time': 1774717083.0, 'created_time': 1774465881.761429, 'last_price_update_time': 1774683303.729659}
2026-03-28 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH49394') HTTP/1.1" 204 0
2026-03-28 07:35:03 [auto1.de] INFO: Found listing with ID: WF02810
2026-03-28 07:35:03 [auto1.de] INFO: Found listing with ID: EY31164
2026-03-28 07:35:03 [auto1.de] INFO: Found listing with ID: DM27402
2026-03-28 07:35:03 [auto1.de] INFO: Found listing with ID: BU80975
2026-03-28 07:35:03 [auto1.de] INFO: Found listing with ID: RS80830
2026-03-28 07:35:03 [auto1.de] INFO: Found listing with ID: VH72276
2026-03-28 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH72276%27 HTTP/1.1" 200 None
2026-03-28 07:35:03 [auto1.de] INFO: Scrape type for VH72276: 0
2026-03-28 07:35:03 [auto1.de] INFO: Found listing with ID: EF16593
2026-03-28 07:35:03 [auto1.de] INFO: Found listing with ID: DC86384
2026-03-28 07:35:03 [auto1.de] INFO: Found listing with ID: XL03429
2026-03-28 07:35:03 [auto1.de] INFO: Found listing with ID: ME80175
2026-03-28 07:35:03 [auto1.de] INFO: Found listing with ID: MM33465
2026-03-28 07:35:03 [auto1.de] INFO: Found listing with ID: LJ19691
2026-03-28 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ19691%27 HTTP/1.1" 200 None
2026-03-28 07:35:03 [auto1.de] INFO: Scrape type for LJ19691: 2
2026-03-28 07:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 007deb63-0da1-5cc0-94bf-5464273ece29 with identifier: LJ19691
2026-03-28 07:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 007deb63-0da1-5cc0-94bf-5464273ece29 with scrape type 2
2026-03-28 07:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 007deb63-0da1-5cc0-94bf-5464273ece29 with scrape type 2
2026-03-28 07:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 007deb63-0da1-5cc0-94bf-5464273ece29, identifier: LJ19691
2026-03-28 07:35:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 007deb63-0da1-5cc0-94bf-5464273ece29 with identifier: LJ19691
2026-03-28 07:35:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 007deb63-0da1-5cc0-94bf-5464273ece29 with identifier: LJ19691
2026-03-28 07:35:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 007deb63-0da1-5cc0-94bf-5464273ece29 with identifier: LJ19691 to the API
2026-03-28 07:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:25:13Z',
'fuel_type': 'petrol',
'id': '007deb63-0da1-5cc0-94bf-5464273ece29',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ19691',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 80659,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-02',
'seller_name': None,
'title': 'Opel Corsa 1.4 Color Edition',
'transmission': 'manual',
'trim': 'Color Edition',
'year': 2017}
2026-03-28 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ19691%27 HTTP/1.1" 200 None
2026-03-28 07:35:04 [auto1.de] INFO: Saving data for LJ19691: {'auction_closing_time': 1774715113.0, 'created_time': 1774466156.030391, 'last_price_update_time': 1774683304.223675}
2026-03-28 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ19691') HTTP/1.1" 204 0
2026-03-28 07:35:04 [auto1.de] INFO: Found listing with ID: UK33318
2026-03-28 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK33318%27 HTTP/1.1" 200 None
2026-03-28 07:35:04 [auto1.de] INFO: Scrape type for UK33318: 2
2026-03-28 07:35:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 450a2eb7-f238-50c6-8197-f08bfb872717 with identifier: UK33318
2026-03-28 07:35:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 450a2eb7-f238-50c6-8197-f08bfb872717 with scrape type 2
2026-03-28 07:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 450a2eb7-f238-50c6-8197-f08bfb872717 with scrape type 2
2026-03-28 07:35:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 450a2eb7-f238-50c6-8197-f08bfb872717, identifier: UK33318
2026-03-28 07:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 450a2eb7-f238-50c6-8197-f08bfb872717 with identifier: UK33318
2026-03-28 07:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 450a2eb7-f238-50c6-8197-f08bfb872717 with identifier: UK33318
2026-03-28 07:35:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 450a2eb7-f238-50c6-8197-f08bfb872717 with identifier: UK33318 to the API
2026-03-28 07:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:52:40Z',
'fuel_type': 'diesel',
'id': '450a2eb7-f238-50c6-8197-f08bfb872717',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK33318',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 282529,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-08-22',
'seller_name': None,
'title': 'Seat Leon 1.9 TDI Torro',
'transmission': 'manual',
'trim': 'Torro',
'year': 2006}
2026-03-28 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK33318%27 HTTP/1.1" 200 None
2026-03-28 07:35:04 [auto1.de] INFO: Saving data for UK33318: {'auction_closing_time': 1774716760.0, 'created_time': 1774467753.088301, 'last_price_update_time': 1774683304.796542}
2026-03-28 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK33318') HTTP/1.1" 204 0
2026-03-28 07:35:04 [auto1.de] INFO: Found listing with ID: GD09618
2026-03-28 07:35:04 [auto1.de] INFO: Found listing with ID: LU10384
2026-03-28 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU10384%27 HTTP/1.1" 200 None
2026-03-28 07:35:04 [auto1.de] INFO: Scrape type for LU10384: 0
2026-03-28 07:35:04 [auto1.de] INFO: Found listing with ID: SW55555
2026-03-28 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW55555%27 HTTP/1.1" 200 None
2026-03-28 07:35:04 [auto1.de] INFO: Scrape type for SW55555: 2
2026-03-28 07:35:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63026590-7659-5959-ab20-b15ac30d383d with identifier: SW55555
2026-03-28 07:35:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63026590-7659-5959-ab20-b15ac30d383d with scrape type 2
2026-03-28 07:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63026590-7659-5959-ab20-b15ac30d383d with scrape type 2
2026-03-28 07:35:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63026590-7659-5959-ab20-b15ac30d383d, identifier: SW55555
2026-03-28 07:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63026590-7659-5959-ab20-b15ac30d383d with identifier: SW55555
2026-03-28 07:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63026590-7659-5959-ab20-b15ac30d383d with identifier: SW55555
2026-03-28 07:35:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63026590-7659-5959-ab20-b15ac30d383d with identifier: SW55555 to the API
2026-03-28 07:35:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:35:49Z',
'fuel_type': 'diesel',
'id': '63026590-7659-5959-ab20-b15ac30d383d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW55555',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 89329,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-29',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2010}
2026-03-28 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW55555%27 HTTP/1.1" 200 None
2026-03-28 07:35:05 [auto1.de] INFO: Saving data for SW55555: {'auction_closing_time': 1774715749.0, 'created_time': 1774466900.625656, 'last_price_update_time': 1774683305.284441}
2026-03-28 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW55555') HTTP/1.1" 204 0
2026-03-28 07:35:05 [auto1.de] INFO: Found listing with ID: DX64051
2026-03-28 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX64051%27 HTTP/1.1" 200 None
2026-03-28 07:35:05 [auto1.de] INFO: Scrape type for DX64051: 0
2026-03-28 07:35:05 [auto1.de] INFO: Found listing with ID: KY27003
2026-03-28 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY27003%27 HTTP/1.1" 200 None
2026-03-28 07:35:05 [auto1.de] INFO: Scrape type for KY27003: 0
2026-03-28 07:35:05 [auto1.de] INFO: Found listing with ID: GC11554
2026-03-28 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC11554%27 HTTP/1.1" 200 None
2026-03-28 07:35:05 [auto1.de] INFO: Scrape type for GC11554: 0
2026-03-28 07:35:05 [auto1.de] INFO: Found listing with ID: DG73763
2026-03-28 07:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:35:05 [auto1.de] INFO: Channel: 24h | Page: 51 | totalHits: 9254 | hits on page: 40
2026-03-28 07:35:05 [auto1.de] INFO: Found listing with ID: DG73763
2026-03-28 07:35:05 [auto1.de] INFO: Found listing with ID: DM75800
2026-03-28 07:35:05 [auto1.de] INFO: Found listing with ID: LK91672
2026-03-28 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK91672%27 HTTP/1.1" 200 None
2026-03-28 07:35:05 [auto1.de] INFO: Scrape type for LK91672: 0
2026-03-28 07:35:05 [auto1.de] INFO: Found listing with ID: DM27876
2026-03-28 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27876%27 HTTP/1.1" 200 None
2026-03-28 07:35:05 [auto1.de] INFO: Scrape type for DM27876: 2
2026-03-28 07:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e56ae25d-afb5-5932-9b64-3c6d5d2860a6 with identifier: DM27876
2026-03-28 07:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e56ae25d-afb5-5932-9b64-3c6d5d2860a6 with scrape type 2
2026-03-28 07:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e56ae25d-afb5-5932-9b64-3c6d5d2860a6 with scrape type 2
2026-03-28 07:35:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e56ae25d-afb5-5932-9b64-3c6d5d2860a6, identifier: DM27876
2026-03-28 07:35:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e56ae25d-afb5-5932-9b64-3c6d5d2860a6 with identifier: DM27876
2026-03-28 07:35:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e56ae25d-afb5-5932-9b64-3c6d5d2860a6 with identifier: DM27876
2026-03-28 07:35:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e56ae25d-afb5-5932-9b64-3c6d5d2860a6 with identifier: DM27876 to the API
2026-03-28 07:35:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:14:55Z',
'fuel_type': 'petrol',
'id': 'e56ae25d-afb5-5932-9b64-3c6d5d2860a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM27876',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 249461,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-12',
'seller_name': None,
'title': 'Audi A6 2.0 TFSI',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-28 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27876%27 HTTP/1.1" 200 None
2026-03-28 07:35:05 [auto1.de] INFO: Saving data for DM27876: {'auction_closing_time': 1774714495.0, 'created_time': 1774466172.202428, 'last_price_update_time': 1774683305.968574}
2026-03-28 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM27876') HTTP/1.1" 204 0
2026-03-28 07:35:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: YJ03455
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ03455%27 HTTP/1.1" 200 None
2026-03-28 07:35:06 [auto1.de] INFO: Scrape type for YJ03455: 0
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: WY50003
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: VZ47534
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: JV13466
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV13466%27 HTTP/1.1" 200 None
2026-03-28 07:35:06 [auto1.de] INFO: Scrape type for JV13466: 0
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: CA25135
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA25135%27 HTTP/1.1" 200 None
2026-03-28 07:35:06 [auto1.de] INFO: Scrape type for CA25135: 0
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: XJ03116
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: GJ22872
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: LY83688
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: RG31591
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG31591%27 HTTP/1.1" 200 None
2026-03-28 07:35:06 [auto1.de] INFO: Scrape type for RG31591: 0
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: AU11749
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU11749%27 HTTP/1.1" 200 None
2026-03-28 07:35:06 [auto1.de] INFO: Scrape type for AU11749: 0
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: WK97473
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: BP97847
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP97847%27 HTTP/1.1" 200 None
2026-03-28 07:35:06 [auto1.de] INFO: Scrape type for BP97847: 0
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: XD31530
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: UU08337
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: ZK10618
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: AW77677
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW77677%27 HTTP/1.1" 200 None
2026-03-28 07:35:06 [auto1.de] INFO: Scrape type for AW77677: 0
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: JR17780
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR17780%27 HTTP/1.1" 200 None
2026-03-28 07:35:06 [auto1.de] INFO: Scrape type for JR17780: 0
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: PJ55553
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ55553%27 HTTP/1.1" 200 None
2026-03-28 07:35:06 [auto1.de] INFO: Scrape type for PJ55553: 0
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: JS18572
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS18572%27 HTTP/1.1" 200 None
2026-03-28 07:35:06 [auto1.de] INFO: Scrape type for JS18572: 0
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: JD92059
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD92059%27 HTTP/1.1" 200 None
2026-03-28 07:35:06 [auto1.de] INFO: Scrape type for JD92059: 0
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: KF61768
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF61768%27 HTTP/1.1" 200 None
2026-03-28 07:35:06 [auto1.de] INFO: Scrape type for KF61768: 2
2026-03-28 07:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 819e4182-bc38-5617-87d4-de71a15d73aa with identifier: KF61768
2026-03-28 07:35:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 819e4182-bc38-5617-87d4-de71a15d73aa with scrape type 2
2026-03-28 07:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 819e4182-bc38-5617-87d4-de71a15d73aa with scrape type 2
2026-03-28 07:35:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 819e4182-bc38-5617-87d4-de71a15d73aa, identifier: KF61768
2026-03-28 07:35:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 819e4182-bc38-5617-87d4-de71a15d73aa with identifier: KF61768
2026-03-28 07:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 819e4182-bc38-5617-87d4-de71a15d73aa with identifier: KF61768
2026-03-28 07:35:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 819e4182-bc38-5617-87d4-de71a15d73aa with identifier: KF61768 to the API
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:52:00Z',
'fuel_type': 'diesel',
'id': '819e4182-bc38-5617-87d4-de71a15d73aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF61768',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 88814,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-08',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 200 CDI BlueTEC Elegance',
'transmission': 'automatic',
'trim': 'BlueTEC Elegance',
'year': 2015}
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF61768%27 HTTP/1.1" 200 None
2026-03-28 07:35:06 [auto1.de] INFO: Saving data for KF61768: {'auction_closing_time': 1774716720.0, 'created_time': 1774467129.353052, 'last_price_update_time': 1774683306.717609}
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF61768') HTTP/1.1" 204 0
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: BU22697
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: KX87155
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: BC57844
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: LC58523
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC58523%27 HTTP/1.1" 200 None
2026-03-28 07:35:06 [auto1.de] INFO: Scrape type for LC58523: 0
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: AW08292
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW08292%27 HTTP/1.1" 200 None
2026-03-28 07:35:06 [auto1.de] INFO: Scrape type for AW08292: 0
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: VF37611
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: UN81742
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN81742%27 HTTP/1.1" 200 None
2026-03-28 07:35:06 [auto1.de] INFO: Scrape type for UN81742: 0
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: FR19321
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR19321%27 HTTP/1.1" 200 None
2026-03-28 07:35:06 [auto1.de] INFO: Scrape type for FR19321: 0
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: MN62628
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: ZU15284
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: ZH11790
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: AB79624
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB79624%27 HTTP/1.1" 200 None
2026-03-28 07:35:06 [auto1.de] INFO: Scrape type for AB79624: 0
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: XE56865
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: WE11389
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE11389%27 HTTP/1.1" 200 None
2026-03-28 07:35:06 [auto1.de] INFO: Scrape type for WE11389: 0
2026-03-28 07:35:06 [auto1.de] INFO: Found listing with ID: DS69815
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS69815%27 HTTP/1.1" 200 None
2026-03-28 07:35:06 [auto1.de] INFO: Scrape type for DS69815: 0
2026-03-28 07:35:06 [scrapy.extensions.logstats] INFO: Crawled 57 pages (at 9 pages/min), scraped 219 items (at 41 items/min)
2026-03-28 07:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 165MiB
2026-03-28 07:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:35:08 [auto1.de] INFO: Channel: 24h | Page: 52 | totalHits: 9254 | hits on page: 40
2026-03-28 07:35:08 [auto1.de] INFO: Found listing with ID: AG24612
2026-03-28 07:35:08 [auto1.de] INFO: Found listing with ID: VC92798
2026-03-28 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC92798%27 HTTP/1.1" 200 None
2026-03-28 07:35:08 [auto1.de] INFO: Scrape type for VC92798: 0
2026-03-28 07:35:08 [auto1.de] INFO: Found listing with ID: FH94786
2026-03-28 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH94786%27 HTTP/1.1" 200 None
2026-03-28 07:35:08 [auto1.de] INFO: Scrape type for FH94786: 0
2026-03-28 07:35:08 [auto1.de] INFO: Found listing with ID: JZ81394
2026-03-28 07:35:08 [auto1.de] INFO: Found listing with ID: UH78050
2026-03-28 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH78050%27 HTTP/1.1" 200 None
2026-03-28 07:35:08 [auto1.de] INFO: Scrape type for UH78050: 0
2026-03-28 07:35:08 [auto1.de] INFO: Found listing with ID: XL13857
2026-03-28 07:35:08 [auto1.de] INFO: Found listing with ID: HP37567
2026-03-28 07:35:08 [auto1.de] INFO: Found listing with ID: WT92712
2026-03-28 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT92712%27 HTTP/1.1" 200 None
2026-03-28 07:35:08 [auto1.de] INFO: Scrape type for WT92712: 0
2026-03-28 07:35:08 [auto1.de] INFO: Found listing with ID: YN46054
2026-03-28 07:35:08 [auto1.de] INFO: Found listing with ID: ZA81194
2026-03-28 07:35:08 [auto1.de] INFO: Found listing with ID: PL31001
2026-03-28 07:35:08 [auto1.de] INFO: Found listing with ID: RU30790
2026-03-28 07:35:08 [auto1.de] INFO: Found listing with ID: XF49404
2026-03-28 07:35:08 [auto1.de] INFO: Found listing with ID: SK57616
2026-03-28 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK57616%27 HTTP/1.1" 200 None
2026-03-28 07:35:08 [auto1.de] INFO: Scrape type for SK57616: 0
2026-03-28 07:35:08 [auto1.de] INFO: Found listing with ID: FH08441
2026-03-28 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH08441%27 HTTP/1.1" 200 None
2026-03-28 07:35:09 [auto1.de] INFO: Scrape type for FH08441: 2
2026-03-28 07:35:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cacc775-984a-54f8-9eb4-d6470a9c2dec with identifier: FH08441
2026-03-28 07:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cacc775-984a-54f8-9eb4-d6470a9c2dec with scrape type 2
2026-03-28 07:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cacc775-984a-54f8-9eb4-d6470a9c2dec with scrape type 2
2026-03-28 07:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6cacc775-984a-54f8-9eb4-d6470a9c2dec, identifier: FH08441
2026-03-28 07:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6cacc775-984a-54f8-9eb4-d6470a9c2dec with identifier: FH08441
2026-03-28 07:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6cacc775-984a-54f8-9eb4-d6470a9c2dec with identifier: FH08441
2026-03-28 07:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6cacc775-984a-54f8-9eb4-d6470a9c2dec with identifier: FH08441 to the API
2026-03-28 07:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:11:16Z',
'fuel_type': 'petrol',
'id': '6cacc775-984a-54f8-9eb4-d6470a9c2dec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH08441',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 86093,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-12',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2021}
2026-03-28 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH08441%27 HTTP/1.1" 200 None
2026-03-28 07:35:09 [auto1.de] INFO: Saving data for FH08441: {'auction_closing_time': 1774714276.0, 'created_time': 1774467347.595927, 'last_price_update_time': 1774683309.424764}
2026-03-28 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH08441') HTTP/1.1" 204 0
2026-03-28 07:35:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:35:09 [auto1.de] INFO: Found listing with ID: PV26171
2026-03-28 07:35:09 [auto1.de] INFO: Found listing with ID: PB92040
2026-03-28 07:35:09 [auto1.de] INFO: Found listing with ID: LP86406
2026-03-28 07:35:09 [auto1.de] INFO: Found listing with ID: FN16508
2026-03-28 07:35:09 [auto1.de] INFO: Found listing with ID: AS18464
2026-03-28 07:35:09 [auto1.de] INFO: Found listing with ID: HY48346
2026-03-28 07:35:09 [auto1.de] INFO: Found listing with ID: JZ38471
2026-03-28 07:35:09 [auto1.de] INFO: Found listing with ID: MV92470
2026-03-28 07:35:09 [auto1.de] INFO: Found listing with ID: VW23219
2026-03-28 07:35:09 [auto1.de] INFO: Found listing with ID: TN75370
2026-03-28 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN75370%27 HTTP/1.1" 200 None
2026-03-28 07:35:09 [auto1.de] INFO: Scrape type for TN75370: 0
2026-03-28 07:35:09 [auto1.de] INFO: Found listing with ID: GD02495
2026-03-28 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD02495%27 HTTP/1.1" 200 None
2026-03-28 07:35:09 [auto1.de] INFO: Scrape type for GD02495: 2
2026-03-28 07:35:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84e9a166-0c14-5f6d-9309-6c7d88f731ac with identifier: GD02495
2026-03-28 07:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84e9a166-0c14-5f6d-9309-6c7d88f731ac with scrape type 2
2026-03-28 07:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84e9a166-0c14-5f6d-9309-6c7d88f731ac with scrape type 2
2026-03-28 07:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84e9a166-0c14-5f6d-9309-6c7d88f731ac, identifier: GD02495
2026-03-28 07:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84e9a166-0c14-5f6d-9309-6c7d88f731ac with identifier: GD02495
2026-03-28 07:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84e9a166-0c14-5f6d-9309-6c7d88f731ac with identifier: GD02495
2026-03-28 07:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84e9a166-0c14-5f6d-9309-6c7d88f731ac with identifier: GD02495 to the API
2026-03-28 07:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-28T16:05:18Z',
'fuel_type': 'hybrid',
'id': '84e9a166-0c14-5f6d-9309-6c7d88f731ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD02495',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 74132,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-17',
'seller_name': None,
'title': 'Toyota Yaris 1.5 Hybrid Life',
'transmission': 'automatic',
'trim': 'Life',
'year': 2013}
2026-03-28 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD02495%27 HTTP/1.1" 200 None
2026-03-28 07:35:09 [auto1.de] INFO: Saving data for GD02495: {'auction_closing_time': 1774713918.0, 'created_time': 1774464350.051066, 'last_price_update_time': 1774683309.983081}
2026-03-28 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD02495') HTTP/1.1" 204 0
2026-03-28 07:35:10 [auto1.de] INFO: Found listing with ID: ZR68100
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR68100%27 HTTP/1.1" 200 None
2026-03-28 07:35:10 [auto1.de] INFO: Scrape type for ZR68100: 0
2026-03-28 07:35:10 [auto1.de] INFO: Found listing with ID: EV16310
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV16310%27 HTTP/1.1" 200 None
2026-03-28 07:35:10 [auto1.de] INFO: Scrape type for EV16310: 0
2026-03-28 07:35:10 [auto1.de] INFO: Found listing with ID: YZ46630
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ46630%27 HTTP/1.1" 200 None
2026-03-28 07:35:10 [auto1.de] INFO: Scrape type for YZ46630: 0
2026-03-28 07:35:10 [auto1.de] INFO: Found listing with ID: ZU43867
2026-03-28 07:35:10 [auto1.de] INFO: Found listing with ID: BL06566
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL06566%27 HTTP/1.1" 200 None
2026-03-28 07:35:10 [auto1.de] INFO: Scrape type for BL06566: 0
2026-03-28 07:35:10 [auto1.de] INFO: Found listing with ID: UP55946
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP55946%27 HTTP/1.1" 200 None
2026-03-28 07:35:10 [auto1.de] INFO: Scrape type for UP55946: 0
2026-03-28 07:35:10 [auto1.de] INFO: Found listing with ID: KS49041
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS49041%27 HTTP/1.1" 200 None
2026-03-28 07:35:10 [auto1.de] INFO: Scrape type for KS49041: 0
2026-03-28 07:35:10 [auto1.de] INFO: Found listing with ID: SD35692
2026-03-28 07:35:10 [auto1.de] INFO: Found listing with ID: AF88464
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF88464%27 HTTP/1.1" 200 None
2026-03-28 07:35:10 [auto1.de] INFO: Scrape type for AF88464: 0
2026-03-28 07:35:10 [auto1.de] INFO: Found listing with ID: LZ96644
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ96644%27 HTTP/1.1" 200 None
2026-03-28 07:35:10 [auto1.de] INFO: Scrape type for LZ96644: 0
2026-03-28 07:35:10 [auto1.de] INFO: Found listing with ID: TA61960
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA61960%27 HTTP/1.1" 200 None
2026-03-28 07:35:10 [auto1.de] INFO: Scrape type for TA61960: 0
2026-03-28 07:35:10 [auto1.de] INFO: Found listing with ID: KW39556
2026-03-28 07:35:10 [auto1.de] INFO: Found listing with ID: NV85283
2026-03-28 07:35:10 [auto1.de] INFO: Found listing with ID: LR83692
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR83692%27 HTTP/1.1" 200 None
2026-03-28 07:35:10 [auto1.de] INFO: Scrape type for LR83692: 2
2026-03-28 07:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37b7d96b-26cc-5144-88be-72c0184f4e24 with identifier: LR83692
2026-03-28 07:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37b7d96b-26cc-5144-88be-72c0184f4e24 with scrape type 2
2026-03-28 07:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37b7d96b-26cc-5144-88be-72c0184f4e24 with scrape type 2
2026-03-28 07:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37b7d96b-26cc-5144-88be-72c0184f4e24, identifier: LR83692
2026-03-28 07:35:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37b7d96b-26cc-5144-88be-72c0184f4e24 with identifier: LR83692
2026-03-28 07:35:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37b7d96b-26cc-5144-88be-72c0184f4e24 with identifier: LR83692
2026-03-28 07:35:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37b7d96b-26cc-5144-88be-72c0184f4e24 with identifier: LR83692 to the API
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:45:00Z',
'fuel_type': 'diesel',
'id': '37b7d96b-26cc-5144-88be-72c0184f4e24',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR83692',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 172575,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-08',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2016}
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR83692%27 HTTP/1.1" 200 None
2026-03-28 07:35:10 [auto1.de] INFO: Saving data for LR83692: {'auction_closing_time': 1774716300.0, 'created_time': 1774466912.872294, 'last_price_update_time': 1774683310.638119}
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR83692') HTTP/1.1" 204 0
2026-03-28 07:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:35:12 [auto1.de] INFO: Channel: 24h | Page: 53 | totalHits: 9254 | hits on page: 40
2026-03-28 07:35:12 [auto1.de] INFO: Found listing with ID: KE96769
2026-03-28 07:35:12 [auto1.de] INFO: Found listing with ID: YX71503
2026-03-28 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX71503%27 HTTP/1.1" 200 None
2026-03-28 07:35:12 [auto1.de] INFO: Scrape type for YX71503: 0
2026-03-28 07:35:12 [auto1.de] INFO: Found listing with ID: YH65606
2026-03-28 07:35:12 [auto1.de] INFO: Found listing with ID: KL74101
2026-03-28 07:35:12 [auto1.de] INFO: Found listing with ID: PC37120
2026-03-28 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC37120%27 HTTP/1.1" 200 None
2026-03-28 07:35:12 [auto1.de] INFO: Scrape type for PC37120: 2
2026-03-28 07:35:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9f4d746-69cb-5fe0-a320-5c574065b1f6 with identifier: PC37120
2026-03-28 07:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9f4d746-69cb-5fe0-a320-5c574065b1f6 with scrape type 2
2026-03-28 07:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9f4d746-69cb-5fe0-a320-5c574065b1f6 with scrape type 2
2026-03-28 07:35:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9f4d746-69cb-5fe0-a320-5c574065b1f6, identifier: PC37120
2026-03-28 07:35:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9f4d746-69cb-5fe0-a320-5c574065b1f6 with identifier: PC37120
2026-03-28 07:35:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9f4d746-69cb-5fe0-a320-5c574065b1f6 with identifier: PC37120
2026-03-28 07:35:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9f4d746-69cb-5fe0-a320-5c574065b1f6 with identifier: PC37120 to the API
2026-03-28 07:35:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:10:27Z',
'fuel_type': 'diesel',
'id': 'f9f4d746-69cb-5fe0-a320-5c574065b1f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC37120',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'V-Klasse',
'odometer': 203650,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-31',
'seller_name': None,
'title': 'Mercedes-Benz V-Klasse V 220 d lang BlueTEC Edition',
'transmission': 'automatic',
'trim': 'lang BlueTEC Edition',
'year': 2016}
2026-03-28 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC37120%27 HTTP/1.1" 200 None
2026-03-28 07:35:13 [auto1.de] INFO: Saving data for PC37120: {'auction_closing_time': 1774714227.0, 'created_time': 1774466390.031538, 'last_price_update_time': 1774683313.862883}
2026-03-28 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC37120') HTTP/1.1" 204 0
2026-03-28 07:35:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:35:13 [auto1.de] INFO: Found listing with ID: HJ54596
2026-03-28 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54596%27 HTTP/1.1" 200 None
2026-03-28 07:35:13 [auto1.de] INFO: Scrape type for HJ54596: 0
2026-03-28 07:35:13 [auto1.de] INFO: Found listing with ID: TJ80177
2026-03-28 07:35:13 [auto1.de] INFO: Found listing with ID: UK07375
2026-03-28 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK07375%27 HTTP/1.1" 200 None
2026-03-28 07:35:13 [auto1.de] INFO: Scrape type for UK07375: 0
2026-03-28 07:35:13 [auto1.de] INFO: Found listing with ID: RC17718
2026-03-28 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC17718%27 HTTP/1.1" 200 None
2026-03-28 07:35:13 [auto1.de] INFO: Scrape type for RC17718: 0
2026-03-28 07:35:13 [auto1.de] INFO: Found listing with ID: SL45224
2026-03-28 07:35:13 [auto1.de] INFO: Found listing with ID: XE57640
2026-03-28 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE57640%27 HTTP/1.1" 200 None
2026-03-28 07:35:13 [auto1.de] INFO: Scrape type for XE57640: 0
2026-03-28 07:35:13 [auto1.de] INFO: Found listing with ID: YD41840
2026-03-28 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD41840%27 HTTP/1.1" 200 None
2026-03-28 07:35:13 [auto1.de] INFO: Scrape type for YD41840: 0
2026-03-28 07:35:13 [auto1.de] INFO: Found listing with ID: LJ92359
2026-03-28 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ92359%27 HTTP/1.1" 200 None
2026-03-28 07:35:13 [auto1.de] INFO: Scrape type for LJ92359: 0
2026-03-28 07:35:13 [auto1.de] INFO: Found listing with ID: AF95896
2026-03-28 07:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF95896%27 HTTP/1.1" 200 None
2026-03-28 07:35:14 [auto1.de] INFO: Scrape type for AF95896: 2
2026-03-28 07:35:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39e83fbc-f5ab-5d19-88f6-a653792704fc with identifier: AF95896
2026-03-28 07:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39e83fbc-f5ab-5d19-88f6-a653792704fc with scrape type 2
2026-03-28 07:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39e83fbc-f5ab-5d19-88f6-a653792704fc with scrape type 2
2026-03-28 07:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39e83fbc-f5ab-5d19-88f6-a653792704fc, identifier: AF95896
2026-03-28 07:35:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39e83fbc-f5ab-5d19-88f6-a653792704fc with identifier: AF95896
2026-03-28 07:35:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39e83fbc-f5ab-5d19-88f6-a653792704fc with identifier: AF95896
2026-03-28 07:35:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39e83fbc-f5ab-5d19-88f6-a653792704fc with identifier: AF95896 to the API
2026-03-28 07:35:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-28T16:10:44Z',
'fuel_type': 'hybrid',
'id': '39e83fbc-f5ab-5d19-88f6-a653792704fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF95896',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 50678,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-04',
'seller_name': None,
'title': 'Volkswagen Golf VIII 1.4 eHybrid Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2022}
2026-03-28 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF95896%27 HTTP/1.1" 200 None
2026-03-28 07:35:14 [auto1.de] INFO: Saving data for AF95896: {'auction_closing_time': 1774714244.0, 'created_time': 1774466976.156715, 'last_price_update_time': 1774683314.420006}
2026-03-28 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF95896') HTTP/1.1" 204 0
2026-03-28 07:35:14 [auto1.de] INFO: Found listing with ID: DN70998
2026-03-28 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN70998%27 HTTP/1.1" 200 None
2026-03-28 07:35:14 [auto1.de] INFO: Scrape type for DN70998: 0
2026-03-28 07:35:14 [auto1.de] INFO: Found listing with ID: XB50161
2026-03-28 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB50161%27 HTTP/1.1" 200 None
2026-03-28 07:35:14 [auto1.de] INFO: Scrape type for XB50161: 0
2026-03-28 07:35:14 [auto1.de] INFO: Found listing with ID: KH18492
2026-03-28 07:35:14 [auto1.de] INFO: Found listing with ID: DR41029
2026-03-28 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR41029%27 HTTP/1.1" 200 None
2026-03-28 07:35:14 [auto1.de] INFO: Scrape type for DR41029: 2
2026-03-28 07:35:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47027004-7934-55fe-a82f-e92a775f2802 with identifier: DR41029
2026-03-28 07:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47027004-7934-55fe-a82f-e92a775f2802 with scrape type 2
2026-03-28 07:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47027004-7934-55fe-a82f-e92a775f2802 with scrape type 2
2026-03-28 07:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47027004-7934-55fe-a82f-e92a775f2802, identifier: DR41029
2026-03-28 07:35:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47027004-7934-55fe-a82f-e92a775f2802 with identifier: DR41029
2026-03-28 07:35:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47027004-7934-55fe-a82f-e92a775f2802 with identifier: DR41029
2026-03-28 07:35:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47027004-7934-55fe-a82f-e92a775f2802 with identifier: DR41029 to the API
2026-03-28 07:35:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:39:53Z',
'fuel_type': 'petrol',
'id': '47027004-7934-55fe-a82f-e92a775f2802',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR41029',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan Allspace',
'odometer': 54273,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-25',
'seller_name': None,
'title': 'Volkswagen Tiguan Allspace 2.0 TSI Highline 4Motion',
'transmission': 'automatic',
'trim': 'Highline 4Motion',
'year': 2019}
2026-03-28 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR41029%27 HTTP/1.1" 200 None
2026-03-28 07:35:14 [auto1.de] INFO: Saving data for DR41029: {'auction_closing_time': 1774715993.0, 'created_time': 1774464237.374454, 'last_price_update_time': 1774683314.986566}
2026-03-28 07:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR41029') HTTP/1.1" 204 0
2026-03-28 07:35:15 [auto1.de] INFO: Found listing with ID: BL02906
2026-03-28 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL02906%27 HTTP/1.1" 200 None
2026-03-28 07:35:15 [auto1.de] INFO: Scrape type for BL02906: 0
2026-03-28 07:35:15 [auto1.de] INFO: Found listing with ID: BF45527
2026-03-28 07:35:15 [auto1.de] INFO: Found listing with ID: CA82513
2026-03-28 07:35:15 [auto1.de] INFO: Found listing with ID: TB88794
2026-03-28 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB88794%27 HTTP/1.1" 200 None
2026-03-28 07:35:15 [auto1.de] INFO: Scrape type for TB88794: 0
2026-03-28 07:35:15 [auto1.de] INFO: Found listing with ID: PY43658
2026-03-28 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY43658%27 HTTP/1.1" 200 None
2026-03-28 07:35:15 [auto1.de] INFO: Scrape type for PY43658: 0
2026-03-28 07:35:15 [auto1.de] INFO: Found listing with ID: RY13097
2026-03-28 07:35:15 [auto1.de] INFO: Found listing with ID: FH05972
2026-03-28 07:35:15 [auto1.de] INFO: Found listing with ID: HD36742
2026-03-28 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD36742%27 HTTP/1.1" 200 None
2026-03-28 07:35:15 [auto1.de] INFO: Scrape type for HD36742: 2
2026-03-28 07:35:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f1ddb10-8b14-5f95-bff2-db4502ae5e7f with identifier: HD36742
2026-03-28 07:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f1ddb10-8b14-5f95-bff2-db4502ae5e7f with scrape type 2
2026-03-28 07:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f1ddb10-8b14-5f95-bff2-db4502ae5e7f with scrape type 2
2026-03-28 07:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f1ddb10-8b14-5f95-bff2-db4502ae5e7f, identifier: HD36742
2026-03-28 07:35:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f1ddb10-8b14-5f95-bff2-db4502ae5e7f with identifier: HD36742
2026-03-28 07:35:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f1ddb10-8b14-5f95-bff2-db4502ae5e7f with identifier: HD36742
2026-03-28 07:35:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f1ddb10-8b14-5f95-bff2-db4502ae5e7f with identifier: HD36742 to the API
2026-03-28 07:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:21:35Z',
'fuel_type': 'petrol',
'id': '2f1ddb10-8b14-5f95-bff2-db4502ae5e7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD36742',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 131551,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-20',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Trendline BlueMotion Tech',
'year': 2014}
2026-03-28 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD36742%27 HTTP/1.1" 200 None
2026-03-28 07:35:15 [auto1.de] INFO: Saving data for HD36742: {'auction_closing_time': 1774714895.0, 'created_time': 1774465995.264401, 'last_price_update_time': 1774683315.49608}
2026-03-28 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD36742') HTTP/1.1" 204 0
2026-03-28 07:35:15 [auto1.de] INFO: Found listing with ID: LB57303
2026-03-28 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB57303%27 HTTP/1.1" 200 None
2026-03-28 07:35:15 [auto1.de] INFO: Scrape type for LB57303: 0
2026-03-28 07:35:15 [auto1.de] INFO: Found listing with ID: TC39197
2026-03-28 07:35:15 [auto1.de] INFO: Found listing with ID: TP88372
2026-03-28 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP88372%27 HTTP/1.1" 200 None
2026-03-28 07:35:15 [auto1.de] INFO: Scrape type for TP88372: 0
2026-03-28 07:35:15 [auto1.de] INFO: Found listing with ID: NV31897
2026-03-28 07:35:15 [auto1.de] INFO: Found listing with ID: NN09397
2026-03-28 07:35:15 [auto1.de] INFO: Found listing with ID: ME32399
2026-03-28 07:35:15 [auto1.de] INFO: Found listing with ID: ZT22955
2026-03-28 07:35:15 [auto1.de] INFO: Found listing with ID: MF52928
2026-03-28 07:35:15 [auto1.de] INFO: Found listing with ID: DZ38540
2026-03-28 07:35:15 [auto1.de] INFO: Found listing with ID: GV28684
2026-03-28 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV28684%27 HTTP/1.1" 200 None
2026-03-28 07:35:15 [auto1.de] INFO: Scrape type for GV28684: 2
2026-03-28 07:35:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08482148-24a4-5327-8081-6c8b545dbe33 with identifier: GV28684
2026-03-28 07:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08482148-24a4-5327-8081-6c8b545dbe33 with scrape type 2
2026-03-28 07:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08482148-24a4-5327-8081-6c8b545dbe33 with scrape type 2
2026-03-28 07:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08482148-24a4-5327-8081-6c8b545dbe33, identifier: GV28684
2026-03-28 07:35:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08482148-24a4-5327-8081-6c8b545dbe33 with identifier: GV28684
2026-03-28 07:35:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08482148-24a4-5327-8081-6c8b545dbe33 with identifier: GV28684
2026-03-28 07:35:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08482148-24a4-5327-8081-6c8b545dbe33 with identifier: GV28684 to the API
2026-03-28 07:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:20:54Z',
'fuel_type': 'petrol',
'id': '08482148-24a4-5327-8081-6c8b545dbe33',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV28684',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 28854,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-30',
'seller_name': None,
'title': 'Hyundai i30 1.0 T-GDI Mild-Hybrid Select',
'transmission': 'automatic',
'trim': 'Select',
'year': 2021}
2026-03-28 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV28684%27 HTTP/1.1" 200 None
2026-03-28 07:35:16 [auto1.de] INFO: Saving data for GV28684: {'auction_closing_time': 1774714854.0, 'created_time': 1773303239.766047, 'last_price_update_time': 1774683316.137304}
2026-03-28 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV28684') HTTP/1.1" 204 0
2026-03-28 07:35:16 [auto1.de] INFO: Found listing with ID: SH94739
2026-03-28 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH94739%27 HTTP/1.1" 200 None
2026-03-28 07:35:16 [auto1.de] INFO: Scrape type for SH94739: 2
2026-03-28 07:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47a0910d-e5a1-58c8-b384-86103bb84eaa with identifier: SH94739
2026-03-28 07:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47a0910d-e5a1-58c8-b384-86103bb84eaa with scrape type 2
2026-03-28 07:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47a0910d-e5a1-58c8-b384-86103bb84eaa with scrape type 2
2026-03-28 07:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47a0910d-e5a1-58c8-b384-86103bb84eaa, identifier: SH94739
2026-03-28 07:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47a0910d-e5a1-58c8-b384-86103bb84eaa with identifier: SH94739
2026-03-28 07:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47a0910d-e5a1-58c8-b384-86103bb84eaa with identifier: SH94739
2026-03-28 07:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47a0910d-e5a1-58c8-b384-86103bb84eaa with identifier: SH94739 to the API
2026-03-28 07:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:56:33Z',
'fuel_type': 'petrol',
'id': '47a0910d-e5a1-58c8-b384-86103bb84eaa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH94739',
'listing': 'auction',
'make': 'Ford',
'model': 'B-Max',
'odometer': 88780,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-18',
'seller_name': None,
'title': 'Ford B-Max 1.4 Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2012}
2026-03-28 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH94739%27 HTTP/1.1" 200 None
2026-03-28 07:35:16 [auto1.de] INFO: Saving data for SH94739: {'auction_closing_time': 1774716993.0, 'created_time': 1774467050.401454, 'last_price_update_time': 1774683316.573191}
2026-03-28 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SH94739') HTTP/1.1" 204 0
2026-03-28 07:35:16 [auto1.de] INFO: Found listing with ID: WM81264
2026-03-28 07:35:16 [auto1.de] INFO: Found listing with ID: VR85495
2026-03-28 07:35:16 [auto1.de] INFO: Found listing with ID: RV27706
2026-03-28 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV27706%27 HTTP/1.1" 200 None
2026-03-28 07:35:16 [auto1.de] INFO: Scrape type for RV27706: 0
2026-03-28 07:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:35:24 [auto1.de] INFO: Channel: 24h | Page: 54 | totalHits: 9254 | hits on page: 40
2026-03-28 07:35:24 [auto1.de] INFO: Found listing with ID: PZ04284
2026-03-28 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ04284%27 HTTP/1.1" 200 None
2026-03-28 07:35:24 [auto1.de] INFO: Scrape type for PZ04284: 2
2026-03-28 07:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81f636b6-3edf-5964-bbf3-0e40ff74ef84 with identifier: PZ04284
2026-03-28 07:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81f636b6-3edf-5964-bbf3-0e40ff74ef84 with scrape type 2
2026-03-28 07:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81f636b6-3edf-5964-bbf3-0e40ff74ef84 with scrape type 2
2026-03-28 07:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81f636b6-3edf-5964-bbf3-0e40ff74ef84, identifier: PZ04284
2026-03-28 07:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81f636b6-3edf-5964-bbf3-0e40ff74ef84 with identifier: PZ04284
2026-03-28 07:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81f636b6-3edf-5964-bbf3-0e40ff74ef84 with identifier: PZ04284
2026-03-28 07:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81f636b6-3edf-5964-bbf3-0e40ff74ef84 with identifier: PZ04284 to the API
2026-03-28 07:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:08:37Z',
'fuel_type': 'petrol',
'id': '81f636b6-3edf-5964-bbf3-0e40ff74ef84',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ04284',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 37086,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-05',
'seller_name': None,
'title': 'Seat Leon 1.5 eTSI ACT FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2022}
2026-03-28 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ04284%27 HTTP/1.1" 200 None
2026-03-28 07:35:24 [auto1.de] INFO: Saving data for PZ04284: {'auction_closing_time': 1774714117.0, 'created_time': 1774466153.249757, 'last_price_update_time': 1774683324.640216}
2026-03-28 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ04284') HTTP/1.1" 204 0
2026-03-28 07:35:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:35:24 [auto1.de] INFO: Found listing with ID: CF43434
2026-03-28 07:35:24 [auto1.de] INFO: Found listing with ID: FT79731
2026-03-28 07:35:24 [auto1.de] INFO: Found listing with ID: HA44433
2026-03-28 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA44433%27 HTTP/1.1" 200 None
2026-03-28 07:35:24 [auto1.de] INFO: Scrape type for HA44433: 0
2026-03-28 07:35:24 [auto1.de] INFO: Found listing with ID: LW30512
2026-03-28 07:35:24 [auto1.de] INFO: Found listing with ID: VG84958
2026-03-28 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG84958%27 HTTP/1.1" 200 None
2026-03-28 07:35:24 [auto1.de] INFO: Scrape type for VG84958: 0
2026-03-28 07:35:24 [auto1.de] INFO: Found listing with ID: ZS26500
2026-03-28 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS26500%27 HTTP/1.1" 200 None
2026-03-28 07:35:24 [auto1.de] INFO: Scrape type for ZS26500: 2
2026-03-28 07:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb997d2b-a52a-51ba-967e-584af059c66e with identifier: ZS26500
2026-03-28 07:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb997d2b-a52a-51ba-967e-584af059c66e with scrape type 2
2026-03-28 07:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb997d2b-a52a-51ba-967e-584af059c66e with scrape type 2
2026-03-28 07:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb997d2b-a52a-51ba-967e-584af059c66e, identifier: ZS26500
2026-03-28 07:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb997d2b-a52a-51ba-967e-584af059c66e with identifier: ZS26500
2026-03-28 07:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb997d2b-a52a-51ba-967e-584af059c66e with identifier: ZS26500
2026-03-28 07:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb997d2b-a52a-51ba-967e-584af059c66e with identifier: ZS26500 to the API
2026-03-28 07:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:43:51Z',
'fuel_type': 'petrol',
'id': 'cb997d2b-a52a-51ba-967e-584af059c66e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS26500',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 213288,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-28',
'seller_name': None,
'title': 'Skoda Fabia 1.4 Cool Edition',
'transmission': 'manual',
'trim': 'Cool Edition',
'year': 2012}
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS26500%27 HTTP/1.1" 200 None
2026-03-28 07:35:25 [auto1.de] INFO: Saving data for ZS26500: {'auction_closing_time': 1774716231.0, 'created_time': 1774467098.429567, 'last_price_update_time': 1774683325.09869}
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS26500') HTTP/1.1" 204 0
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: LC02400
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: BG27502
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG27502%27 HTTP/1.1" 200 None
2026-03-28 07:35:25 [auto1.de] INFO: Scrape type for BG27502: 2
2026-03-28 07:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9680988a-4e3c-56ee-a2c1-a4617ede8a44 with identifier: BG27502
2026-03-28 07:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9680988a-4e3c-56ee-a2c1-a4617ede8a44 with scrape type 2
2026-03-28 07:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9680988a-4e3c-56ee-a2c1-a4617ede8a44 with scrape type 2
2026-03-28 07:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9680988a-4e3c-56ee-a2c1-a4617ede8a44, identifier: BG27502
2026-03-28 07:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9680988a-4e3c-56ee-a2c1-a4617ede8a44 with identifier: BG27502
2026-03-28 07:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9680988a-4e3c-56ee-a2c1-a4617ede8a44 with identifier: BG27502
2026-03-28 07:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9680988a-4e3c-56ee-a2c1-a4617ede8a44 with identifier: BG27502 to the API
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:36:52Z',
'fuel_type': 'petrol',
'id': '9680988a-4e3c-56ee-a2c1-a4617ede8a44',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG27502',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 145477,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-03',
'seller_name': None,
'title': 'Ford Kuga 1.5 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2018}
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG27502%27 HTTP/1.1" 200 None
2026-03-28 07:35:25 [auto1.de] INFO: Saving data for BG27502: {'auction_closing_time': 1774715812.0, 'created_time': 1773858811.369283, 'last_price_update_time': 1774683325.517479}
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG27502') HTTP/1.1" 204 0
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: YJ00075
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: KM40443
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM40443%27 HTTP/1.1" 200 None
2026-03-28 07:35:25 [auto1.de] INFO: Scrape type for KM40443: 0
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: RB81391
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB81391%27 HTTP/1.1" 200 None
2026-03-28 07:35:25 [auto1.de] INFO: Scrape type for RB81391: 0
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: RK40199
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: YA96721
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA96721%27 HTTP/1.1" 200 None
2026-03-28 07:35:25 [auto1.de] INFO: Scrape type for YA96721: 0
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: MR13527
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR13527%27 HTTP/1.1" 200 None
2026-03-28 07:35:25 [auto1.de] INFO: Scrape type for MR13527: 0
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: WU62760
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: DB98628
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB98628%27 HTTP/1.1" 200 None
2026-03-28 07:35:25 [auto1.de] INFO: Scrape type for DB98628: 0
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: TE12513
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: MS10711
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS10711%27 HTTP/1.1" 200 None
2026-03-28 07:35:25 [auto1.de] INFO: Scrape type for MS10711: 0
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: GM94647
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: BS49761
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS49761%27 HTTP/1.1" 200 None
2026-03-28 07:35:25 [auto1.de] INFO: Scrape type for BS49761: 0
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: GK30038
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: ZT89022
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT89022%27 HTTP/1.1" 200 None
2026-03-28 07:35:25 [auto1.de] INFO: Scrape type for ZT89022: 0
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: MK32086
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK32086%27 HTTP/1.1" 200 None
2026-03-28 07:35:25 [auto1.de] INFO: Scrape type for MK32086: 0
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: CU27746
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU27746%27 HTTP/1.1" 200 None
2026-03-28 07:35:25 [auto1.de] INFO: Scrape type for CU27746: 0
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: PR91039
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR91039%27 HTTP/1.1" 200 None
2026-03-28 07:35:25 [auto1.de] INFO: Scrape type for PR91039: 0
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: JG07802
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG07802%27 HTTP/1.1" 200 None
2026-03-28 07:35:25 [auto1.de] INFO: Scrape type for JG07802: 0
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: ZP84126
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: AW92068
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW92068%27 HTTP/1.1" 200 None
2026-03-28 07:35:25 [auto1.de] INFO: Scrape type for AW92068: 0
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: MZ53691
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: JC14398
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: EJ11673
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: GP79065
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: GR07934
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR07934%27 HTTP/1.1" 200 None
2026-03-28 07:35:25 [auto1.de] INFO: Scrape type for GR07934: 0
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: WV76032
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: KG77617
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: SD72171
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD72171%27 HTTP/1.1" 200 None
2026-03-28 07:35:25 [auto1.de] INFO: Scrape type for SD72171: 0
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: ZU63901
2026-03-28 07:35:25 [auto1.de] INFO: Found listing with ID: SU27774
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU27774%27 HTTP/1.1" 200 None
2026-03-28 07:35:25 [auto1.de] INFO: Scrape type for SU27774: 2
2026-03-28 07:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2aec503e-589f-5f4d-a135-f1e480fa2333 with identifier: SU27774
2026-03-28 07:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2aec503e-589f-5f4d-a135-f1e480fa2333 with scrape type 2
2026-03-28 07:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2aec503e-589f-5f4d-a135-f1e480fa2333 with scrape type 2
2026-03-28 07:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2aec503e-589f-5f4d-a135-f1e480fa2333, identifier: SU27774
2026-03-28 07:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2aec503e-589f-5f4d-a135-f1e480fa2333 with identifier: SU27774
2026-03-28 07:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2aec503e-589f-5f4d-a135-f1e480fa2333 with identifier: SU27774
2026-03-28 07:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2aec503e-589f-5f4d-a135-f1e480fa2333 with identifier: SU27774 to the API
2026-03-28 07:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:49:38Z',
'fuel_type': 'diesel',
'id': '2aec503e-589f-5f4d-a135-f1e480fa2333',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU27774',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 211232,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-27',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2014}
2026-03-28 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU27774%27 HTTP/1.1" 200 None
2026-03-28 07:35:26 [auto1.de] INFO: Saving data for SU27774: {'auction_closing_time': 1774716578.0, 'created_time': 1774467626.080988, 'last_price_update_time': 1774683326.298884}
2026-03-28 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU27774') HTTP/1.1" 204 0
2026-03-28 07:35:26 [auto1.de] INFO: Found listing with ID: LX73205
2026-03-28 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX73205%27 HTTP/1.1" 200 None
2026-03-28 07:35:26 [auto1.de] INFO: Scrape type for LX73205: 0
2026-03-28 07:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:35:27 [auto1.de] INFO: Channel: 24h | Page: 55 | totalHits: 9254 | hits on page: 40
2026-03-28 07:35:27 [auto1.de] INFO: Found listing with ID: HC04240
2026-03-28 07:35:27 [auto1.de] INFO: Found listing with ID: MV64998
2026-03-28 07:35:27 [auto1.de] INFO: Found listing with ID: BH45132
2026-03-28 07:35:27 [auto1.de] INFO: Found listing with ID: LC77842
2026-03-28 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC77842%27 HTTP/1.1" 200 None
2026-03-28 07:35:27 [auto1.de] INFO: Scrape type for LC77842: 0
2026-03-28 07:35:27 [auto1.de] INFO: Found listing with ID: FA77948
2026-03-28 07:35:27 [auto1.de] INFO: Found listing with ID: BC48090
2026-03-28 07:35:27 [auto1.de] INFO: Found listing with ID: WP14042
2026-03-28 07:35:27 [auto1.de] INFO: Found listing with ID: GF22355
2026-03-28 07:35:27 [auto1.de] INFO: Found listing with ID: XA54655
2026-03-28 07:35:27 [auto1.de] INFO: Found listing with ID: WK49047
2026-03-28 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK49047%27 HTTP/1.1" 200 None
2026-03-28 07:35:27 [auto1.de] INFO: Scrape type for WK49047: 0
2026-03-28 07:35:27 [auto1.de] INFO: Found listing with ID: BA71155
2026-03-28 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA71155%27 HTTP/1.1" 200 None
2026-03-28 07:35:27 [auto1.de] INFO: Scrape type for BA71155: 2
2026-03-28 07:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5cae17e-162c-5963-b238-c2e279b085bf with identifier: BA71155
2026-03-28 07:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5cae17e-162c-5963-b238-c2e279b085bf with scrape type 2
2026-03-28 07:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5cae17e-162c-5963-b238-c2e279b085bf with scrape type 2
2026-03-28 07:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5cae17e-162c-5963-b238-c2e279b085bf, identifier: BA71155
2026-03-28 07:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5cae17e-162c-5963-b238-c2e279b085bf with identifier: BA71155
2026-03-28 07:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5cae17e-162c-5963-b238-c2e279b085bf with identifier: BA71155
2026-03-28 07:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5cae17e-162c-5963-b238-c2e279b085bf with identifier: BA71155 to the API
2026-03-28 07:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:41:01Z',
'fuel_type': 'petrol',
'id': 'b5cae17e-162c-5963-b238-c2e279b085bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA71155',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 100111,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-11',
'seller_name': None,
'title': 'Opel Mokka X 1.4 Turbo Innovation',
'transmission': 'automatic',
'trim': 'Innovation',
'year': 2019}
2026-03-28 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA71155%27 HTTP/1.1" 200 None
2026-03-28 07:35:28 [auto1.de] INFO: Saving data for BA71155: {'auction_closing_time': 1774716061.0, 'created_time': 1774466313.544675, 'last_price_update_time': 1774683328.367734}
2026-03-28 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA71155') HTTP/1.1" 204 0
2026-03-28 07:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:35:28 [auto1.de] INFO: Found listing with ID: BS97689
2026-03-28 07:35:28 [auto1.de] INFO: Found listing with ID: EV18023
2026-03-28 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV18023%27 HTTP/1.1" 200 None
2026-03-28 07:35:28 [auto1.de] INFO: Scrape type for EV18023: 2
2026-03-28 07:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 801e4bcd-a308-58f2-879e-1eb27b272af4 with identifier: EV18023
2026-03-28 07:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 801e4bcd-a308-58f2-879e-1eb27b272af4 with scrape type 2
2026-03-28 07:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 801e4bcd-a308-58f2-879e-1eb27b272af4 with scrape type 2
2026-03-28 07:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 801e4bcd-a308-58f2-879e-1eb27b272af4, identifier: EV18023
2026-03-28 07:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 801e4bcd-a308-58f2-879e-1eb27b272af4 with identifier: EV18023
2026-03-28 07:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 801e4bcd-a308-58f2-879e-1eb27b272af4 with identifier: EV18023
2026-03-28 07:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 801e4bcd-a308-58f2-879e-1eb27b272af4 with identifier: EV18023 to the API
2026-03-28 07:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:27:43Z',
'fuel_type': 'diesel',
'id': '801e4bcd-a308-58f2-879e-1eb27b272af4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV18023',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 147186,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-29',
'seller_name': None,
'title': 'Seat Leon 1.6 TDI Connect',
'transmission': 'manual',
'trim': 'Connect',
'year': 2015}
2026-03-28 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV18023%27 HTTP/1.1" 200 None
2026-03-28 07:35:28 [auto1.de] INFO: Saving data for EV18023: {'auction_closing_time': 1774715263.0, 'created_time': 1774503051.109448, 'last_price_update_time': 1774683328.910041}
2026-03-28 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV18023') HTTP/1.1" 204 0
2026-03-28 07:35:28 [auto1.de] INFO: Found listing with ID: YB86536
2026-03-28 07:35:28 [auto1.de] INFO: Found listing with ID: XC96921
2026-03-28 07:35:28 [auto1.de] INFO: Found listing with ID: BZ86499
2026-03-28 07:35:28 [auto1.de] INFO: Found listing with ID: GJ82091
2026-03-28 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ82091%27 HTTP/1.1" 200 None
2026-03-28 07:35:28 [auto1.de] INFO: Scrape type for GJ82091: 0
2026-03-28 07:35:28 [auto1.de] INFO: Found listing with ID: DZ18684
2026-03-28 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ18684%27 HTTP/1.1" 200 None
2026-03-28 07:35:28 [auto1.de] INFO: Scrape type for DZ18684: 0
2026-03-28 07:35:28 [auto1.de] INFO: Found listing with ID: CS22386
2026-03-28 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS22386%27 HTTP/1.1" 200 None
2026-03-28 07:35:28 [auto1.de] INFO: Scrape type for CS22386: 2
2026-03-28 07:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00de2d7f-6ee2-5aec-bcb6-4a8e5d8f3988 with identifier: CS22386
2026-03-28 07:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00de2d7f-6ee2-5aec-bcb6-4a8e5d8f3988 with scrape type 2
2026-03-28 07:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00de2d7f-6ee2-5aec-bcb6-4a8e5d8f3988 with scrape type 2
2026-03-28 07:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00de2d7f-6ee2-5aec-bcb6-4a8e5d8f3988, identifier: CS22386
2026-03-28 07:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00de2d7f-6ee2-5aec-bcb6-4a8e5d8f3988 with identifier: CS22386
2026-03-28 07:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00de2d7f-6ee2-5aec-bcb6-4a8e5d8f3988 with identifier: CS22386
2026-03-28 07:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00de2d7f-6ee2-5aec-bcb6-4a8e5d8f3988 with identifier: CS22386 to the API
2026-03-28 07:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:51:39Z',
'fuel_type': 'diesel',
'id': '00de2d7f-6ee2-5aec-bcb6-4a8e5d8f3988',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS22386',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 143507,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-08',
'seller_name': None,
'title': 'Ford Transit 2.2 TDCi 270 L1 Trend',
'transmission': 'manual',
'trim': '270 L1 Trend',
'year': 2016}
2026-03-28 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS22386%27 HTTP/1.1" 200 None
2026-03-28 07:35:29 [auto1.de] INFO: Saving data for CS22386: {'auction_closing_time': 1774716699.0, 'created_time': 1774467689.673332, 'last_price_update_time': 1774683329.410704}
2026-03-28 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS22386') HTTP/1.1" 204 0
2026-03-28 07:35:29 [auto1.de] INFO: Found listing with ID: MJ41570
2026-03-28 07:35:29 [auto1.de] INFO: Found listing with ID: NZ41454
2026-03-28 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ41454%27 HTTP/1.1" 200 None
2026-03-28 07:35:29 [auto1.de] INFO: Scrape type for NZ41454: 0
2026-03-28 07:35:29 [auto1.de] INFO: Found listing with ID: AT21596
2026-03-28 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT21596%27 HTTP/1.1" 200 None
2026-03-28 07:35:29 [auto1.de] INFO: Scrape type for AT21596: 0
2026-03-28 07:35:29 [auto1.de] INFO: Found listing with ID: VL43028
2026-03-28 07:35:29 [auto1.de] INFO: Found listing with ID: ME93940
2026-03-28 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME93940%27 HTTP/1.1" 200 None
2026-03-28 07:35:29 [auto1.de] INFO: Scrape type for ME93940: 0
2026-03-28 07:35:29 [auto1.de] INFO: Found listing with ID: PK76037
2026-03-28 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK76037%27 HTTP/1.1" 200 None
2026-03-28 07:35:29 [auto1.de] INFO: Scrape type for PK76037: 2
2026-03-28 07:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75701526-2549-5e29-97dd-f2ee76aa604d with identifier: PK76037
2026-03-28 07:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75701526-2549-5e29-97dd-f2ee76aa604d with scrape type 2
2026-03-28 07:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75701526-2549-5e29-97dd-f2ee76aa604d with scrape type 2
2026-03-28 07:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75701526-2549-5e29-97dd-f2ee76aa604d, identifier: PK76037
2026-03-28 07:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75701526-2549-5e29-97dd-f2ee76aa604d with identifier: PK76037
2026-03-28 07:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75701526-2549-5e29-97dd-f2ee76aa604d with identifier: PK76037
2026-03-28 07:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75701526-2549-5e29-97dd-f2ee76aa604d with identifier: PK76037 to the API
2026-03-28 07:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:58:34Z',
'fuel_type': 'petrol',
'id': '75701526-2549-5e29-97dd-f2ee76aa604d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK76037',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 48600,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-28',
'seller_name': None,
'title': 'Opel Astra 1.4 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2010}
2026-03-28 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK76037%27 HTTP/1.1" 200 None
2026-03-28 07:35:29 [auto1.de] INFO: Saving data for PK76037: {'auction_closing_time': 1774717114.0, 'created_time': 1774464486.557765, 'last_price_update_time': 1774683329.932626}
2026-03-28 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK76037') HTTP/1.1" 204 0
2026-03-28 07:35:30 [auto1.de] INFO: Found listing with ID: ZD11825
2026-03-28 07:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD11825%27 HTTP/1.1" 200 None
2026-03-28 07:35:30 [auto1.de] INFO: Scrape type for ZD11825: 0
2026-03-28 07:35:30 [auto1.de] INFO: Found listing with ID: BD92301
2026-03-28 07:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92301%27 HTTP/1.1" 200 None
2026-03-28 07:35:30 [auto1.de] INFO: Scrape type for BD92301: 0
2026-03-28 07:35:30 [auto1.de] INFO: Found listing with ID: CK82561
2026-03-28 07:35:30 [auto1.de] INFO: Found listing with ID: MJ46117
2026-03-28 07:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ46117%27 HTTP/1.1" 200 None
2026-03-28 07:35:30 [auto1.de] INFO: Scrape type for MJ46117: 0
2026-03-28 07:35:30 [auto1.de] INFO: Found listing with ID: HH84290
2026-03-28 07:35:30 [auto1.de] INFO: Found listing with ID: RP33469
2026-03-28 07:35:30 [auto1.de] INFO: Found listing with ID: VT95404
2026-03-28 07:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT95404%27 HTTP/1.1" 200 None
2026-03-28 07:35:30 [auto1.de] INFO: Scrape type for VT95404: 0
2026-03-28 07:35:30 [auto1.de] INFO: Found listing with ID: ND67175
2026-03-28 07:35:30 [auto1.de] INFO: Found listing with ID: CN84106
2026-03-28 07:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN84106%27 HTTP/1.1" 200 None
2026-03-28 07:35:30 [auto1.de] INFO: Scrape type for CN84106: 0
2026-03-28 07:35:30 [auto1.de] INFO: Found listing with ID: XV81276
2026-03-28 07:35:30 [auto1.de] INFO: Found listing with ID: AB82349
2026-03-28 07:35:30 [auto1.de] INFO: Found listing with ID: XR02791
2026-03-28 07:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR02791%27 HTTP/1.1" 200 None
2026-03-28 07:35:30 [auto1.de] INFO: Scrape type for XR02791: 0
2026-03-28 07:35:30 [auto1.de] INFO: Found listing with ID: FK98396
2026-03-28 07:35:30 [auto1.de] INFO: Found listing with ID: KH38301
2026-03-28 07:35:30 [auto1.de] INFO: Found listing with ID: GW25301
2026-03-28 07:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:35:30 [auto1.de] INFO: Channel: 24h | Page: 56 | totalHits: 9254 | hits on page: 40
2026-03-28 07:35:30 [auto1.de] INFO: Found listing with ID: DS74430
2026-03-28 07:35:30 [auto1.de] INFO: Found listing with ID: XE55302
2026-03-28 07:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE55302%27 HTTP/1.1" 200 None
2026-03-28 07:35:30 [auto1.de] INFO: Scrape type for XE55302: 0
2026-03-28 07:35:30 [auto1.de] INFO: Found listing with ID: GE49775
2026-03-28 07:35:30 [auto1.de] INFO: Found listing with ID: KN20653
2026-03-28 07:35:30 [auto1.de] INFO: Found listing with ID: ZZ49819
2026-03-28 07:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ49819%27 HTTP/1.1" 200 None
2026-03-28 07:35:30 [auto1.de] INFO: Scrape type for ZZ49819: 2
2026-03-28 07:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f94babbe-48aa-580d-8390-7dddba9e5604 with identifier: ZZ49819
2026-03-28 07:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f94babbe-48aa-580d-8390-7dddba9e5604 with scrape type 2
2026-03-28 07:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f94babbe-48aa-580d-8390-7dddba9e5604 with scrape type 2
2026-03-28 07:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f94babbe-48aa-580d-8390-7dddba9e5604, identifier: ZZ49819
2026-03-28 07:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f94babbe-48aa-580d-8390-7dddba9e5604 with identifier: ZZ49819
2026-03-28 07:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f94babbe-48aa-580d-8390-7dddba9e5604 with identifier: ZZ49819
2026-03-28 07:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f94babbe-48aa-580d-8390-7dddba9e5604 with identifier: ZZ49819 to the API
2026-03-28 07:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:34:13Z',
'fuel_type': 'petrol',
'id': 'f94babbe-48aa-580d-8390-7dddba9e5604',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ49819',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 225798,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-10-18',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2010}
2026-03-28 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ49819%27 HTTP/1.1" 200 None
2026-03-28 07:35:31 [auto1.de] INFO: Saving data for ZZ49819: {'auction_closing_time': 1774715653.0, 'created_time': 1774466937.504682, 'last_price_update_time': 1774683331.750567}
2026-03-28 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ49819') HTTP/1.1" 204 0
2026-03-28 07:35:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:35:31 [auto1.de] INFO: Found listing with ID: JF61688
2026-03-28 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF61688%27 HTTP/1.1" 200 None
2026-03-28 07:35:31 [auto1.de] INFO: Scrape type for JF61688: 2
2026-03-28 07:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3019761c-d8fb-5a51-bb8d-f730598629b4 with identifier: JF61688
2026-03-28 07:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3019761c-d8fb-5a51-bb8d-f730598629b4 with scrape type 2
2026-03-28 07:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3019761c-d8fb-5a51-bb8d-f730598629b4 with scrape type 2
2026-03-28 07:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3019761c-d8fb-5a51-bb8d-f730598629b4, identifier: JF61688
2026-03-28 07:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3019761c-d8fb-5a51-bb8d-f730598629b4 with identifier: JF61688
2026-03-28 07:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3019761c-d8fb-5a51-bb8d-f730598629b4 with identifier: JF61688
2026-03-28 07:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3019761c-d8fb-5a51-bb8d-f730598629b4 with identifier: JF61688 to the API
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-03-28T16:53:12Z',
'fuel_type': 'diesel',
'id': '3019761c-d8fb-5a51-bb8d-f730598629b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF61688',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 367766,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-29',
'seller_name': None,
'title': 'BMW 5er 530d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2011}
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF61688%27 HTTP/1.1" 200 None
2026-03-28 07:35:32 [auto1.de] INFO: Saving data for JF61688: {'auction_closing_time': 1774716792.0, 'created_time': 1774466945.30272, 'last_price_update_time': 1774683332.331505}
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JF61688') HTTP/1.1" 204 0
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: ZM65799
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: LN55732
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN55732%27 HTTP/1.1" 200 None
2026-03-28 07:35:32 [auto1.de] INFO: Scrape type for LN55732: 0
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: MM30364
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM30364%27 HTTP/1.1" 200 None
2026-03-28 07:35:32 [auto1.de] INFO: Scrape type for MM30364: 2
2026-03-28 07:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cedd9544-f517-50fc-b7d9-7ae1cf377a99 with identifier: MM30364
2026-03-28 07:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cedd9544-f517-50fc-b7d9-7ae1cf377a99 with scrape type 2
2026-03-28 07:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cedd9544-f517-50fc-b7d9-7ae1cf377a99 with scrape type 2
2026-03-28 07:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cedd9544-f517-50fc-b7d9-7ae1cf377a99, identifier: MM30364
2026-03-28 07:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cedd9544-f517-50fc-b7d9-7ae1cf377a99 with identifier: MM30364
2026-03-28 07:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cedd9544-f517-50fc-b7d9-7ae1cf377a99 with identifier: MM30364
2026-03-28 07:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cedd9544-f517-50fc-b7d9-7ae1cf377a99 with identifier: MM30364 to the API
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:10:35Z',
'fuel_type': 'diesel',
'id': 'cedd9544-f517-50fc-b7d9-7ae1cf377a99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM30364',
'listing': 'auction',
'make': 'Citroen',
'model': 'DS3',
'odometer': 177744,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-18',
'seller_name': None,
'title': 'Citroen DS3 1.6 Blue-HDi So Paris',
'transmission': 'manual',
'trim': 'So Paris',
'year': 2014}
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM30364%27 HTTP/1.1" 200 None
2026-03-28 07:35:32 [auto1.de] INFO: Saving data for MM30364: {'auction_closing_time': 1774714235.0, 'created_time': 1773829873.087483, 'last_price_update_time': 1774683332.813281}
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM30364') HTTP/1.1" 204 0
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: SX57791
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: NM13557
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM13557%27 HTTP/1.1" 200 None
2026-03-28 07:35:32 [auto1.de] INFO: Scrape type for NM13557: 0
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: DV41165
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: TP63692
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: LD46189
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: ET29931
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET29931%27 HTTP/1.1" 200 None
2026-03-28 07:35:32 [auto1.de] INFO: Scrape type for ET29931: 0
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: GU26871
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU26871%27 HTTP/1.1" 200 None
2026-03-28 07:35:32 [auto1.de] INFO: Scrape type for GU26871: 0
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: XE39544
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: CF62011
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: UE09477
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: LH30739
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH30739%27 HTTP/1.1" 200 None
2026-03-28 07:35:32 [auto1.de] INFO: Scrape type for LH30739: 0
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: CC98432
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC98432%27 HTTP/1.1" 200 None
2026-03-28 07:35:32 [auto1.de] INFO: Scrape type for CC98432: 0
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: PS42902
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS42902%27 HTTP/1.1" 200 None
2026-03-28 07:35:32 [auto1.de] INFO: Scrape type for PS42902: 0
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: PH91659
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: DR32988
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: DV40482
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: AR52184
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: JK90168
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: WY85656
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: BR02529
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: JH22526
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH22526%27 HTTP/1.1" 200 None
2026-03-28 07:35:32 [auto1.de] INFO: Scrape type for JH22526: 0
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: RK01073
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK01073%27 HTTP/1.1" 200 None
2026-03-28 07:35:32 [auto1.de] INFO: Scrape type for RK01073: 0
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: MX37752
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX37752%27 HTTP/1.1" 200 None
2026-03-28 07:35:32 [auto1.de] INFO: Scrape type for MX37752: 0
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: YM52195
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM52195%27 HTTP/1.1" 200 None
2026-03-28 07:35:32 [auto1.de] INFO: Scrape type for YM52195: 0
2026-03-28 07:35:32 [auto1.de] INFO: Found listing with ID: VJ16820
2026-03-28 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ16820%27 HTTP/1.1" 200 None
2026-03-28 07:35:33 [auto1.de] INFO: Scrape type for VJ16820: 2
2026-03-28 07:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4a507f2-f8e0-5a61-a837-1d8e5b267450 with identifier: VJ16820
2026-03-28 07:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4a507f2-f8e0-5a61-a837-1d8e5b267450 with scrape type 2
2026-03-28 07:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4a507f2-f8e0-5a61-a837-1d8e5b267450 with scrape type 2
2026-03-28 07:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4a507f2-f8e0-5a61-a837-1d8e5b267450, identifier: VJ16820
2026-03-28 07:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4a507f2-f8e0-5a61-a837-1d8e5b267450 with identifier: VJ16820
2026-03-28 07:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4a507f2-f8e0-5a61-a837-1d8e5b267450 with identifier: VJ16820
2026-03-28 07:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4a507f2-f8e0-5a61-a837-1d8e5b267450 with identifier: VJ16820 to the API
2026-03-28 07:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:20:13Z',
'fuel_type': 'petrol',
'id': 'f4a507f2-f8e0-5a61-a837-1d8e5b267450',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ16820',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 101869,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-24',
'seller_name': None,
'title': 'Volkswagen Passat 1.4 TSI ACT Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2016}
2026-03-28 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ16820%27 HTTP/1.1" 200 None
2026-03-28 07:35:33 [auto1.de] INFO: Saving data for VJ16820: {'auction_closing_time': 1774714813.0, 'created_time': 1774464649.153757, 'last_price_update_time': 1774683333.450055}
2026-03-28 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ16820') HTTP/1.1" 204 0
2026-03-28 07:35:33 [auto1.de] INFO: Found listing with ID: VV84209
2026-03-28 07:35:33 [auto1.de] INFO: Found listing with ID: KN80130
2026-03-28 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN80130%27 HTTP/1.1" 200 None
2026-03-28 07:35:33 [auto1.de] INFO: Scrape type for KN80130: 0
2026-03-28 07:35:33 [auto1.de] INFO: Found listing with ID: EW23969
2026-03-28 07:35:33 [auto1.de] INFO: Found listing with ID: FT93387
2026-03-28 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT93387%27 HTTP/1.1" 200 None
2026-03-28 07:35:33 [auto1.de] INFO: Scrape type for FT93387: 0
2026-03-28 07:35:33 [auto1.de] INFO: Found listing with ID: CH69099
2026-03-28 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH69099%27 HTTP/1.1" 200 None
2026-03-28 07:35:33 [auto1.de] INFO: Scrape type for CH69099: 0
2026-03-28 07:35:33 [auto1.de] INFO: Found listing with ID: FH56090
2026-03-28 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH56090%27 HTTP/1.1" 200 None
2026-03-28 07:35:33 [auto1.de] INFO: Scrape type for FH56090: 0
2026-03-28 07:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:35:34 [auto1.de] INFO: Channel: 24h | Page: 57 | totalHits: 9254 | hits on page: 40
2026-03-28 07:35:34 [auto1.de] INFO: Found listing with ID: PS41324
2026-03-28 07:35:34 [auto1.de] INFO: Found listing with ID: JB65350
2026-03-28 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB65350%27 HTTP/1.1" 200 None
2026-03-28 07:35:34 [auto1.de] INFO: Scrape type for JB65350: 0
2026-03-28 07:35:34 [auto1.de] INFO: Found listing with ID: MJ38460
2026-03-28 07:35:34 [auto1.de] INFO: Found listing with ID: JC93229
2026-03-28 07:35:34 [auto1.de] INFO: Found listing with ID: TP70009
2026-03-28 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP70009%27 HTTP/1.1" 200 None
2026-03-28 07:35:34 [auto1.de] INFO: Scrape type for TP70009: 0
2026-03-28 07:35:34 [auto1.de] INFO: Found listing with ID: BY42207
2026-03-28 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY42207%27 HTTP/1.1" 200 None
2026-03-28 07:35:34 [auto1.de] INFO: Scrape type for BY42207: 0
2026-03-28 07:35:34 [auto1.de] INFO: Found listing with ID: AP34925
2026-03-28 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP34925%27 HTTP/1.1" 200 None
2026-03-28 07:35:34 [auto1.de] INFO: Scrape type for AP34925: 0
2026-03-28 07:35:34 [auto1.de] INFO: Found listing with ID: LU46905
2026-03-28 07:35:34 [auto1.de] INFO: Found listing with ID: RL83266
2026-03-28 07:35:34 [auto1.de] INFO: Found listing with ID: AA51921
2026-03-28 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA51921%27 HTTP/1.1" 200 None
2026-03-28 07:35:34 [auto1.de] INFO: Scrape type for AA51921: 0
2026-03-28 07:35:34 [auto1.de] INFO: Found listing with ID: TR42945
2026-03-28 07:35:34 [auto1.de] INFO: Found listing with ID: UN09274
2026-03-28 07:35:34 [auto1.de] INFO: Found listing with ID: KH43150
2026-03-28 07:35:34 [auto1.de] INFO: Found listing with ID: YU64534
2026-03-28 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU64534%27 HTTP/1.1" 200 None
2026-03-28 07:35:34 [auto1.de] INFO: Scrape type for YU64534: 2
2026-03-28 07:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a668e5d8-7db0-5bfd-908e-c1086300c58a with identifier: YU64534
2026-03-28 07:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a668e5d8-7db0-5bfd-908e-c1086300c58a with scrape type 2
2026-03-28 07:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a668e5d8-7db0-5bfd-908e-c1086300c58a with scrape type 2
2026-03-28 07:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a668e5d8-7db0-5bfd-908e-c1086300c58a, identifier: YU64534
2026-03-28 07:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a668e5d8-7db0-5bfd-908e-c1086300c58a with identifier: YU64534
2026-03-28 07:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a668e5d8-7db0-5bfd-908e-c1086300c58a with identifier: YU64534
2026-03-28 07:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a668e5d8-7db0-5bfd-908e-c1086300c58a with identifier: YU64534 to the API
2026-03-28 07:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:20:18Z',
'fuel_type': 'diesel',
'id': 'a668e5d8-7db0-5bfd-908e-c1086300c58a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU64534',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 142588,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-19',
'seller_name': None,
'title': 'Ford Transit 1.5 TDCi Kombi Trend',
'transmission': 'manual',
'trim': 'Kombi Trend',
'year': 2017}
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU64534%27 HTTP/1.1" 200 None
2026-03-28 07:35:35 [auto1.de] INFO: Saving data for YU64534: {'auction_closing_time': 1774714818.0, 'created_time': 1774466713.155084, 'last_price_update_time': 1774683335.01602}
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU64534') HTTP/1.1" 204 0
2026-03-28 07:35:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: PY53054
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY53054%27 HTTP/1.1" 200 None
2026-03-28 07:35:35 [auto1.de] INFO: Scrape type for PY53054: 0
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: SJ83553
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ83553%27 HTTP/1.1" 200 None
2026-03-28 07:35:35 [auto1.de] INFO: Scrape type for SJ83553: 0
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: FM49388
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM49388%27 HTTP/1.1" 200 None
2026-03-28 07:35:35 [auto1.de] INFO: Scrape type for FM49388: 0
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: BZ51273
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: EE74949
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE74949%27 HTTP/1.1" 200 None
2026-03-28 07:35:35 [auto1.de] INFO: Scrape type for EE74949: 0
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: MV36698
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: GR83523
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: BE42770
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE42770%27 HTTP/1.1" 200 None
2026-03-28 07:35:35 [auto1.de] INFO: Scrape type for BE42770: 0
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: KJ27126
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ27126%27 HTTP/1.1" 200 None
2026-03-28 07:35:35 [auto1.de] INFO: Scrape type for KJ27126: 0
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: XA01561
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA01561%27 HTTP/1.1" 200 None
2026-03-28 07:35:35 [auto1.de] INFO: Scrape type for XA01561: 0
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: JD86845
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: FX79800
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: YM11561
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM11561%27 HTTP/1.1" 200 None
2026-03-28 07:35:35 [auto1.de] INFO: Scrape type for YM11561: 0
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: AG57248
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: RM09243
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: NX12512
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX12512%27 HTTP/1.1" 200 None
2026-03-28 07:35:35 [auto1.de] INFO: Scrape type for NX12512: 2
2026-03-28 07:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145 with identifier: NX12512
2026-03-28 07:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145 with scrape type 2
2026-03-28 07:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145 with scrape type 2
2026-03-28 07:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145, identifier: NX12512
2026-03-28 07:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145 with identifier: NX12512
2026-03-28 07:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145 with identifier: NX12512
2026-03-28 07:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e518cf9-48cc-5d8c-9ee7-26ccbf51c145 with identifier: NX12512 to the API
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 313,
'expiration_date': '2026-03-28T16:25:15Z',
'fuel_type': 'diesel',
'id': '8e518cf9-48cc-5d8c-9ee7-26ccbf51c145',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX12512',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 209234,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-09',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2013}
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX12512%27 HTTP/1.1" 200 None
2026-03-28 07:35:35 [auto1.de] INFO: Saving data for NX12512: {'auction_closing_time': 1774715115.0, 'created_time': 1774466209.054014, 'last_price_update_time': 1774683335.684779}
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX12512') HTTP/1.1" 204 0
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: PV27021
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: WD01270
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: CS93004
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: GB76211
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB76211%27 HTTP/1.1" 200 None
2026-03-28 07:35:35 [auto1.de] INFO: Scrape type for GB76211: 0
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: XZ96479
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: YY13791
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY13791%27 HTTP/1.1" 200 None
2026-03-28 07:35:35 [auto1.de] INFO: Scrape type for YY13791: 0
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: MM04684
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM04684%27 HTTP/1.1" 200 None
2026-03-28 07:35:35 [auto1.de] INFO: Scrape type for MM04684: 0
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: MP44977
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP44977%27 HTTP/1.1" 200 None
2026-03-28 07:35:35 [auto1.de] INFO: Scrape type for MP44977: 0
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: JY21775
2026-03-28 07:35:35 [auto1.de] INFO: Found listing with ID: ES44709
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES44709%27 HTTP/1.1" 200 None
2026-03-28 07:35:35 [auto1.de] INFO: Scrape type for ES44709: 0
2026-03-28 07:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:35:36 [auto1.de] INFO: Channel: 24h | Page: 58 | totalHits: 9254 | hits on page: 40
2026-03-28 07:35:36 [auto1.de] INFO: Found listing with ID: UM76387
2026-03-28 07:35:36 [auto1.de] INFO: Found listing with ID: XS81054
2026-03-28 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS81054%27 HTTP/1.1" 200 None
2026-03-28 07:35:36 [auto1.de] INFO: Scrape type for XS81054: 2
2026-03-28 07:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3c5b9e0-a6dc-5369-9b84-6d5b0620c4a1 with identifier: XS81054
2026-03-28 07:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3c5b9e0-a6dc-5369-9b84-6d5b0620c4a1 with scrape type 2
2026-03-28 07:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3c5b9e0-a6dc-5369-9b84-6d5b0620c4a1 with scrape type 2
2026-03-28 07:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3c5b9e0-a6dc-5369-9b84-6d5b0620c4a1, identifier: XS81054
2026-03-28 07:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3c5b9e0-a6dc-5369-9b84-6d5b0620c4a1 with identifier: XS81054
2026-03-28 07:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3c5b9e0-a6dc-5369-9b84-6d5b0620c4a1 with identifier: XS81054
2026-03-28 07:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3c5b9e0-a6dc-5369-9b84-6d5b0620c4a1 with identifier: XS81054 to the API
2026-03-28 07:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-28T16:05:44Z',
'fuel_type': 'petrol',
'id': 'd3c5b9e0-a6dc-5369-9b84-6d5b0620c4a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS81054',
'listing': 'auction',
'make': 'Skoda',
'model': 'Citigo',
'odometer': 80391,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-23',
'seller_name': None,
'title': 'Skoda Citigo 1.0 MPI Cool Edition',
'transmission': 'manual',
'trim': 'Cool Edition',
'year': 2016}
2026-03-28 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS81054%27 HTTP/1.1" 200 None
2026-03-28 07:35:37 [auto1.de] INFO: Saving data for XS81054: {'auction_closing_time': 1774713944.0, 'created_time': 1774465752.193551, 'last_price_update_time': 1774683337.269324}
2026-03-28 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS81054') HTTP/1.1" 204 0
2026-03-28 07:35:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:35:37 [auto1.de] INFO: Found listing with ID: DX42832
2026-03-28 07:35:37 [auto1.de] INFO: Found listing with ID: RV98185
2026-03-28 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV98185%27 HTTP/1.1" 200 None
2026-03-28 07:35:37 [auto1.de] INFO: Scrape type for RV98185: 2
2026-03-28 07:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 684b989a-93f8-5cd0-b96b-8dbe618a3957 with identifier: RV98185
2026-03-28 07:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 684b989a-93f8-5cd0-b96b-8dbe618a3957 with scrape type 2
2026-03-28 07:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 684b989a-93f8-5cd0-b96b-8dbe618a3957 with scrape type 2
2026-03-28 07:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 684b989a-93f8-5cd0-b96b-8dbe618a3957, identifier: RV98185
2026-03-28 07:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 684b989a-93f8-5cd0-b96b-8dbe618a3957 with identifier: RV98185
2026-03-28 07:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 684b989a-93f8-5cd0-b96b-8dbe618a3957 with identifier: RV98185
2026-03-28 07:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 684b989a-93f8-5cd0-b96b-8dbe618a3957 with identifier: RV98185 to the API
2026-03-28 07:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:44:51Z',
'fuel_type': 'petrol',
'id': '684b989a-93f8-5cd0-b96b-8dbe618a3957',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV98185',
'listing': 'auction',
'make': 'Hyundai',
'model': 'ix20',
'odometer': 63483,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-07',
'seller_name': None,
'title': 'Hyundai ix20 1.4 YES! Blue',
'transmission': 'manual',
'trim': 'YES! Blue',
'year': 2015}
2026-03-28 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV98185%27 HTTP/1.1" 200 None
2026-03-28 07:35:37 [auto1.de] INFO: Saving data for RV98185: {'auction_closing_time': 1774716291.0, 'created_time': 1774466863.225484, 'last_price_update_time': 1774683337.790398}
2026-03-28 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV98185') HTTP/1.1" 204 0
2026-03-28 07:35:37 [auto1.de] INFO: Found listing with ID: XS50208
2026-03-28 07:35:37 [auto1.de] INFO: Found listing with ID: MD51854
2026-03-28 07:35:37 [auto1.de] INFO: Found listing with ID: RZ65813
2026-03-28 07:35:37 [auto1.de] INFO: Found listing with ID: BZ50840
2026-03-28 07:35:37 [auto1.de] INFO: Found listing with ID: TC55492
2026-03-28 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC55492%27 HTTP/1.1" 200 None
2026-03-28 07:35:37 [auto1.de] INFO: Scrape type for TC55492: 0
2026-03-28 07:35:37 [auto1.de] INFO: Found listing with ID: AR80743
2026-03-28 07:35:37 [auto1.de] INFO: Found listing with ID: LZ29816
2026-03-28 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ29816%27 HTTP/1.1" 200 None
2026-03-28 07:35:37 [auto1.de] INFO: Scrape type for LZ29816: 0
2026-03-28 07:35:37 [auto1.de] INFO: Found listing with ID: JW22409
2026-03-28 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW22409%27 HTTP/1.1" 200 None
2026-03-28 07:35:37 [auto1.de] INFO: Scrape type for JW22409: 2
2026-03-28 07:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 605ba021-67ab-5be9-9579-8446dbad6477 with identifier: JW22409
2026-03-28 07:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 605ba021-67ab-5be9-9579-8446dbad6477 with scrape type 2
2026-03-28 07:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 605ba021-67ab-5be9-9579-8446dbad6477 with scrape type 2
2026-03-28 07:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 605ba021-67ab-5be9-9579-8446dbad6477, identifier: JW22409
2026-03-28 07:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 605ba021-67ab-5be9-9579-8446dbad6477 with identifier: JW22409
2026-03-28 07:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 605ba021-67ab-5be9-9579-8446dbad6477 with identifier: JW22409
2026-03-28 07:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 605ba021-67ab-5be9-9579-8446dbad6477 with identifier: JW22409 to the API
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:41:37Z',
'fuel_type': 'petrol',
'id': '605ba021-67ab-5be9-9579-8446dbad6477',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW22409',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 186921,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-07',
'seller_name': None,
'title': 'Skoda Octavia 1.6 Tour',
'transmission': 'manual',
'trim': 'Tour',
'year': 2009}
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW22409%27 HTTP/1.1" 200 None
2026-03-28 07:35:38 [auto1.de] INFO: Saving data for JW22409: {'auction_closing_time': 1774716097.0, 'created_time': 1774466152.645656, 'last_price_update_time': 1774683338.267931}
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JW22409') HTTP/1.1" 204 0
2026-03-28 07:35:38 [auto1.de] INFO: Found listing with ID: FE77986
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE77986%27 HTTP/1.1" 200 None
2026-03-28 07:35:38 [auto1.de] INFO: Scrape type for FE77986: 0
2026-03-28 07:35:38 [auto1.de] INFO: Found listing with ID: GB55517
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB55517%27 HTTP/1.1" 200 None
2026-03-28 07:35:38 [auto1.de] INFO: Scrape type for GB55517: 0
2026-03-28 07:35:38 [auto1.de] INFO: Found listing with ID: XY25128
2026-03-28 07:35:38 [auto1.de] INFO: Found listing with ID: UD97315
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD97315%27 HTTP/1.1" 200 None
2026-03-28 07:35:38 [auto1.de] INFO: Scrape type for UD97315: 2
2026-03-28 07:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76113821-818a-5e69-b341-9f002db08a4e with identifier: UD97315
2026-03-28 07:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76113821-818a-5e69-b341-9f002db08a4e with scrape type 2
2026-03-28 07:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76113821-818a-5e69-b341-9f002db08a4e with scrape type 2
2026-03-28 07:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76113821-818a-5e69-b341-9f002db08a4e, identifier: UD97315
2026-03-28 07:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76113821-818a-5e69-b341-9f002db08a4e with identifier: UD97315
2026-03-28 07:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76113821-818a-5e69-b341-9f002db08a4e with identifier: UD97315
2026-03-28 07:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76113821-818a-5e69-b341-9f002db08a4e with identifier: UD97315 to the API
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:03:20Z',
'fuel_type': 'petrol',
'id': '76113821-818a-5e69-b341-9f002db08a4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD97315',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 187593,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-13',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Trendline BlueMotion Tech',
'year': 2015}
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD97315%27 HTTP/1.1" 200 None
2026-03-28 07:35:38 [auto1.de] INFO: Saving data for UD97315: {'auction_closing_time': 1774713800.0, 'created_time': 1774467019.448185, 'last_price_update_time': 1774683338.739362}
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD97315') HTTP/1.1" 204 0
2026-03-28 07:35:38 [auto1.de] INFO: Found listing with ID: EW93148
2026-03-28 07:35:38 [auto1.de] INFO: Found listing with ID: ZN11233
2026-03-28 07:35:38 [auto1.de] INFO: Found listing with ID: ME08351
2026-03-28 07:35:38 [auto1.de] INFO: Found listing with ID: DK08351
2026-03-28 07:35:38 [auto1.de] INFO: Found listing with ID: YG22612
2026-03-28 07:35:38 [auto1.de] INFO: Found listing with ID: AY25775
2026-03-28 07:35:38 [auto1.de] INFO: Found listing with ID: UZ22488
2026-03-28 07:35:38 [auto1.de] INFO: Found listing with ID: EN23227
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN23227%27 HTTP/1.1" 200 None
2026-03-28 07:35:38 [auto1.de] INFO: Scrape type for EN23227: 0
2026-03-28 07:35:38 [auto1.de] INFO: Found listing with ID: CT54176
2026-03-28 07:35:38 [auto1.de] INFO: Found listing with ID: RM92330
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM92330%27 HTTP/1.1" 200 None
2026-03-28 07:35:38 [auto1.de] INFO: Scrape type for RM92330: 0
2026-03-28 07:35:38 [auto1.de] INFO: Found listing with ID: DK43665
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK43665%27 HTTP/1.1" 200 None
2026-03-28 07:35:38 [auto1.de] INFO: Scrape type for DK43665: 0
2026-03-28 07:35:38 [auto1.de] INFO: Found listing with ID: YZ92306
2026-03-28 07:35:38 [auto1.de] INFO: Found listing with ID: NA68427
2026-03-28 07:35:38 [auto1.de] INFO: Found listing with ID: LS63557
2026-03-28 07:35:38 [auto1.de] INFO: Found listing with ID: YB09580
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB09580%27 HTTP/1.1" 200 None
2026-03-28 07:35:38 [auto1.de] INFO: Scrape type for YB09580: 0
2026-03-28 07:35:38 [auto1.de] INFO: Found listing with ID: GZ67786
2026-03-28 07:35:38 [auto1.de] INFO: Found listing with ID: UN40728
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN40728%27 HTTP/1.1" 200 None
2026-03-28 07:35:38 [auto1.de] INFO: Scrape type for UN40728: 0
2026-03-28 07:35:38 [auto1.de] INFO: Found listing with ID: KU77644
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU77644%27 HTTP/1.1" 200 None
2026-03-28 07:35:38 [auto1.de] INFO: Scrape type for KU77644: 2
2026-03-28 07:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0efe9dc9-4f96-5248-976c-7539049b86ce with identifier: KU77644
2026-03-28 07:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0efe9dc9-4f96-5248-976c-7539049b86ce with scrape type 2
2026-03-28 07:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0efe9dc9-4f96-5248-976c-7539049b86ce with scrape type 2
2026-03-28 07:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0efe9dc9-4f96-5248-976c-7539049b86ce, identifier: KU77644
2026-03-28 07:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0efe9dc9-4f96-5248-976c-7539049b86ce with identifier: KU77644
2026-03-28 07:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0efe9dc9-4f96-5248-976c-7539049b86ce with identifier: KU77644
2026-03-28 07:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0efe9dc9-4f96-5248-976c-7539049b86ce with identifier: KU77644 to the API
2026-03-28 07:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 145,
'expiration_date': '2026-03-28T16:01:45Z',
'fuel_type': 'petrol',
'id': '0efe9dc9-4f96-5248-976c-7539049b86ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU77644',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Santa Fe',
'odometer': 353438,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-06-23',
'seller_name': None,
'title': 'Hyundai Santa Fe 2.4 GLS Team 06',
'transmission': 'manual',
'trim': 'GLS Team 06',
'year': 2005}
2026-03-28 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU77644%27 HTTP/1.1" 200 None
2026-03-28 07:35:39 [auto1.de] INFO: Saving data for KU77644: {'auction_closing_time': 1774713705.0, 'created_time': 1774465966.26235, 'last_price_update_time': 1774683339.346044}
2026-03-28 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU77644') HTTP/1.1" 204 0
2026-03-28 07:35:39 [auto1.de] INFO: Found listing with ID: RK25728
2026-03-28 07:35:39 [auto1.de] INFO: Found listing with ID: GE71174
2026-03-28 07:35:39 [auto1.de] INFO: Found listing with ID: WL63965
2026-03-28 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL63965%27 HTTP/1.1" 200 None
2026-03-28 07:35:39 [auto1.de] INFO: Scrape type for WL63965: 0
2026-03-28 07:35:39 [auto1.de] INFO: Found listing with ID: YR16927
2026-03-28 07:35:39 [auto1.de] INFO: Found listing with ID: PD02193
2026-03-28 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD02193%27 HTTP/1.1" 200 None
2026-03-28 07:35:39 [auto1.de] INFO: Scrape type for PD02193: 0
2026-03-28 07:35:39 [auto1.de] INFO: Found listing with ID: LM46602
2026-03-28 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM46602%27 HTTP/1.1" 200 None
2026-03-28 07:35:39 [auto1.de] INFO: Scrape type for LM46602: 0
2026-03-28 07:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:35:41 [auto1.de] INFO: Channel: 24h | Page: 59 | totalHits: 9254 | hits on page: 40
2026-03-28 07:35:41 [auto1.de] INFO: Found listing with ID: HL50945
2026-03-28 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL50945%27 HTTP/1.1" 200 None
2026-03-28 07:35:41 [auto1.de] INFO: Scrape type for HL50945: 0
2026-03-28 07:35:41 [auto1.de] INFO: Found listing with ID: TY96424
2026-03-28 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY96424%27 HTTP/1.1" 200 None
2026-03-28 07:35:41 [auto1.de] INFO: Scrape type for TY96424: 0
2026-03-28 07:35:41 [auto1.de] INFO: Found listing with ID: ES32816
2026-03-28 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES32816%27 HTTP/1.1" 200 None
2026-03-28 07:35:41 [auto1.de] INFO: Scrape type for ES32816: 0
2026-03-28 07:35:41 [auto1.de] INFO: Found listing with ID: BR02307
2026-03-28 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR02307%27 HTTP/1.1" 200 None
2026-03-28 07:35:41 [auto1.de] INFO: Scrape type for BR02307: 0
2026-03-28 07:35:41 [auto1.de] INFO: Found listing with ID: NH81971
2026-03-28 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH81971%27 HTTP/1.1" 200 None
2026-03-28 07:35:41 [auto1.de] INFO: Scrape type for NH81971: 0
2026-03-28 07:35:41 [auto1.de] INFO: Found listing with ID: GE82925
2026-03-28 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE82925%27 HTTP/1.1" 200 None
2026-03-28 07:35:41 [auto1.de] INFO: Scrape type for GE82925: 0
2026-03-28 07:35:41 [auto1.de] INFO: Found listing with ID: BK55447
2026-03-28 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK55447%27 HTTP/1.1" 200 None
2026-03-28 07:35:41 [auto1.de] INFO: Scrape type for BK55447: 2
2026-03-28 07:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad6c5e80-9e66-52b8-9390-eb159792c2bd with identifier: BK55447
2026-03-28 07:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad6c5e80-9e66-52b8-9390-eb159792c2bd with scrape type 2
2026-03-28 07:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad6c5e80-9e66-52b8-9390-eb159792c2bd with scrape type 2
2026-03-28 07:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad6c5e80-9e66-52b8-9390-eb159792c2bd, identifier: BK55447
2026-03-28 07:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad6c5e80-9e66-52b8-9390-eb159792c2bd with identifier: BK55447
2026-03-28 07:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad6c5e80-9e66-52b8-9390-eb159792c2bd with identifier: BK55447
2026-03-28 07:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad6c5e80-9e66-52b8-9390-eb159792c2bd with identifier: BK55447 to the API
2026-03-28 07:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 165,
'expiration_date': '2026-03-28T16:55:39Z',
'fuel_type': 'petrol',
'id': 'ad6c5e80-9e66-52b8-9390-eb159792c2bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK55447',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Alfa Spider',
'odometer': 66742,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-08-22',
'seller_name': None,
'title': 'Alfa Romeo Alfa Spider 2.0 JTS Medio',
'transmission': 'manual',
'trim': 'Medio',
'year': 2006}
2026-03-28 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK55447%27 HTTP/1.1" 200 None
2026-03-28 07:35:41 [auto1.de] INFO: Saving data for BK55447: {'auction_closing_time': 1774716939.0, 'created_time': 1774466414.459054, 'last_price_update_time': 1774683341.682506}
2026-03-28 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK55447') HTTP/1.1" 204 0
2026-03-28 07:35:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:35:41 [auto1.de] INFO: Found listing with ID: TD64872
2026-03-28 07:35:41 [auto1.de] INFO: Found listing with ID: VH83950
2026-03-28 07:35:41 [auto1.de] INFO: Found listing with ID: EH25554
2026-03-28 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH25554%27 HTTP/1.1" 200 None
2026-03-28 07:35:41 [auto1.de] INFO: Scrape type for EH25554: 0
2026-03-28 07:35:41 [auto1.de] INFO: Found listing with ID: CS89362
2026-03-28 07:35:41 [auto1.de] INFO: Found listing with ID: BK72669
2026-03-28 07:35:41 [auto1.de] INFO: Found listing with ID: RL57383
2026-03-28 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL57383%27 HTTP/1.1" 200 None
2026-03-28 07:35:41 [auto1.de] INFO: Scrape type for RL57383: 2
2026-03-28 07:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f16953f-5968-5ef3-ab62-643360fa0f71 with identifier: RL57383
2026-03-28 07:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f16953f-5968-5ef3-ab62-643360fa0f71 with scrape type 2
2026-03-28 07:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f16953f-5968-5ef3-ab62-643360fa0f71 with scrape type 2
2026-03-28 07:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f16953f-5968-5ef3-ab62-643360fa0f71, identifier: RL57383
2026-03-28 07:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f16953f-5968-5ef3-ab62-643360fa0f71 with identifier: RL57383
2026-03-28 07:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f16953f-5968-5ef3-ab62-643360fa0f71 with identifier: RL57383
2026-03-28 07:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f16953f-5968-5ef3-ab62-643360fa0f71 with identifier: RL57383 to the API
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 300,
'expiration_date': '2026-03-28T16:16:02Z',
'fuel_type': 'petrol',
'id': '2f16953f-5968-5ef3-ab62-643360fa0f71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL57383',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 18502,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-30',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TSI GTI Clubsport',
'transmission': 'automatic',
'trim': 'GTI Clubsport',
'year': 2023}
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL57383%27 HTTP/1.1" 200 None
2026-03-28 07:35:42 [auto1.de] INFO: Saving data for RL57383: {'auction_closing_time': 1774714562.0, 'created_time': 1774466670.076864, 'last_price_update_time': 1774683342.285084}
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL57383') HTTP/1.1" 204 0
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: SN89547
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: JX39487
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: CC27418
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC27418%27 HTTP/1.1" 200 None
2026-03-28 07:35:42 [auto1.de] INFO: Scrape type for CC27418: 0
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: BF60599
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF60599%27 HTTP/1.1" 200 None
2026-03-28 07:35:42 [auto1.de] INFO: Scrape type for BF60599: 0
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: NC93129
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC93129%27 HTTP/1.1" 200 None
2026-03-28 07:35:42 [auto1.de] INFO: Scrape type for NC93129: 0
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: ZV59345
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: PP25437
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: JC97573
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: VC98877
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC98877%27 HTTP/1.1" 200 None
2026-03-28 07:35:42 [auto1.de] INFO: Scrape type for VC98877: 0
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: UV60068
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: KK41609
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK41609%27 HTTP/1.1" 200 None
2026-03-28 07:35:42 [auto1.de] INFO: Scrape type for KK41609: 0
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: UV13467
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: RX19676
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: HM31508
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM31508%27 HTTP/1.1" 200 None
2026-03-28 07:35:42 [auto1.de] INFO: Scrape type for HM31508: 0
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: LE88532
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: CN59781
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN59781%27 HTTP/1.1" 200 None
2026-03-28 07:35:42 [auto1.de] INFO: Scrape type for CN59781: 2
2026-03-28 07:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 801eb981-8bee-53b4-87cf-fccb833324b9 with identifier: CN59781
2026-03-28 07:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 801eb981-8bee-53b4-87cf-fccb833324b9 with scrape type 2
2026-03-28 07:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 801eb981-8bee-53b4-87cf-fccb833324b9 with scrape type 2
2026-03-28 07:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 801eb981-8bee-53b4-87cf-fccb833324b9, identifier: CN59781
2026-03-28 07:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 801eb981-8bee-53b4-87cf-fccb833324b9 with identifier: CN59781
2026-03-28 07:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 801eb981-8bee-53b4-87cf-fccb833324b9 with identifier: CN59781
2026-03-28 07:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 801eb981-8bee-53b4-87cf-fccb833324b9 with identifier: CN59781 to the API
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-28T16:07:17Z',
'fuel_type': 'petrol',
'id': '801eb981-8bee-53b4-87cf-fccb833324b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN59781',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 3021,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-12-05',
'seller_name': None,
'title': 'Volkswagen Caddy 1.5 TSI',
'transmission': 'automatic',
'trim': '',
'year': 2024}
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN59781%27 HTTP/1.1" 200 None
2026-03-28 07:35:42 [auto1.de] INFO: Saving data for CN59781: {'auction_closing_time': 1774714037.0, 'created_time': 1774467015.387954, 'last_price_update_time': 1774683342.809513}
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN59781') HTTP/1.1" 204 0
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: ZG99162
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: YT47833
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: WJ94391
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ94391%27 HTTP/1.1" 200 None
2026-03-28 07:35:42 [auto1.de] INFO: Scrape type for WJ94391: 0
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: VV51818
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: CT61733
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT61733%27 HTTP/1.1" 200 None
2026-03-28 07:35:42 [auto1.de] INFO: Scrape type for CT61733: 0
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: WW54945
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: NC87687
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: VH61709
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH61709%27 HTTP/1.1" 200 None
2026-03-28 07:35:42 [auto1.de] INFO: Scrape type for VH61709: 0
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: FF39586
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: PC62388
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC62388%27 HTTP/1.1" 200 None
2026-03-28 07:35:42 [auto1.de] INFO: Scrape type for PC62388: 0
2026-03-28 07:35:42 [auto1.de] INFO: Found listing with ID: EL27695
2026-03-28 07:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:35:43 [auto1.de] INFO: Channel: 24h | Page: 60 | totalHits: 9254 | hits on page: 40
2026-03-28 07:35:43 [auto1.de] INFO: Found listing with ID: ND00067
2026-03-28 07:35:43 [auto1.de] INFO: Found listing with ID: ZF09358
2026-03-28 07:35:43 [auto1.de] INFO: Found listing with ID: AE37337
2026-03-28 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE37337%27 HTTP/1.1" 200 None
2026-03-28 07:35:43 [auto1.de] INFO: Scrape type for AE37337: 0
2026-03-28 07:35:43 [auto1.de] INFO: Found listing with ID: AL53534
2026-03-28 07:35:43 [auto1.de] INFO: Found listing with ID: MK52280
2026-03-28 07:35:43 [auto1.de] INFO: Found listing with ID: TH96479
2026-03-28 07:35:43 [auto1.de] INFO: Found listing with ID: TD39885
2026-03-28 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD39885%27 HTTP/1.1" 200 None
2026-03-28 07:35:43 [auto1.de] INFO: Scrape type for TD39885: 2
2026-03-28 07:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b481af6b-d548-5942-bb4e-f4bf61db2f03 with identifier: TD39885
2026-03-28 07:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b481af6b-d548-5942-bb4e-f4bf61db2f03 with scrape type 2
2026-03-28 07:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b481af6b-d548-5942-bb4e-f4bf61db2f03 with scrape type 2
2026-03-28 07:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b481af6b-d548-5942-bb4e-f4bf61db2f03, identifier: TD39885
2026-03-28 07:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b481af6b-d548-5942-bb4e-f4bf61db2f03 with identifier: TD39885
2026-03-28 07:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b481af6b-d548-5942-bb4e-f4bf61db2f03 with identifier: TD39885
2026-03-28 07:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b481af6b-d548-5942-bb4e-f4bf61db2f03 with identifier: TD39885 to the API
2026-03-28 07:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:01:07Z',
'fuel_type': 'diesel',
'id': 'b481af6b-d548-5942-bb4e-f4bf61db2f03',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD39885',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 101208,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-24',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Titanium AWD',
'transmission': 'automatic',
'trim': 'Titanium AWD',
'year': 2016}
2026-03-28 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD39885%27 HTTP/1.1" 200 None
2026-03-28 07:35:44 [auto1.de] INFO: Saving data for TD39885: {'auction_closing_time': 1774713667.0, 'created_time': 1774465132.502961, 'last_price_update_time': 1774683344.24961}
2026-03-28 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD39885') HTTP/1.1" 204 0
2026-03-28 07:35:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:35:44 [auto1.de] INFO: Found listing with ID: KT42918
2026-03-28 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT42918%27 HTTP/1.1" 200 None
2026-03-28 07:35:44 [auto1.de] INFO: Scrape type for KT42918: 2
2026-03-28 07:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fc1170f-5324-5fab-beaf-72f954d05fb4 with identifier: KT42918
2026-03-28 07:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fc1170f-5324-5fab-beaf-72f954d05fb4 with scrape type 2
2026-03-28 07:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fc1170f-5324-5fab-beaf-72f954d05fb4 with scrape type 2
2026-03-28 07:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3fc1170f-5324-5fab-beaf-72f954d05fb4, identifier: KT42918
2026-03-28 07:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3fc1170f-5324-5fab-beaf-72f954d05fb4 with identifier: KT42918
2026-03-28 07:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3fc1170f-5324-5fab-beaf-72f954d05fb4 with identifier: KT42918
2026-03-28 07:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3fc1170f-5324-5fab-beaf-72f954d05fb4 with identifier: KT42918 to the API
2026-03-28 07:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-28T16:48:24Z',
'fuel_type': 'diesel',
'id': '3fc1170f-5324-5fab-beaf-72f954d05fb4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT42918',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 162369,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-30',
'seller_name': None,
'title': 'Audi A1 Sportback 2.0 TDI S line Sportpaket',
'transmission': 'manual',
'trim': 'S line Sportpaket',
'year': 2013}
2026-03-28 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT42918%27 HTTP/1.1" 200 None
2026-03-28 07:35:44 [auto1.de] INFO: Saving data for KT42918: {'auction_closing_time': 1774716504.0, 'created_time': 1774466192.788649, 'last_price_update_time': 1774683344.817853}
2026-03-28 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT42918') HTTP/1.1" 204 0
2026-03-28 07:35:44 [auto1.de] INFO: Found listing with ID: GM15631
2026-03-28 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM15631%27 HTTP/1.1" 200 None
2026-03-28 07:35:44 [auto1.de] INFO: Scrape type for GM15631: 0
2026-03-28 07:35:44 [auto1.de] INFO: Found listing with ID: HY87386
2026-03-28 07:35:44 [auto1.de] INFO: Found listing with ID: AF90097
2026-03-28 07:35:44 [auto1.de] INFO: Found listing with ID: HZ17968
2026-03-28 07:35:44 [auto1.de] INFO: Found listing with ID: JM70147
2026-03-28 07:35:44 [auto1.de] INFO: Found listing with ID: AN69467
2026-03-28 07:35:44 [auto1.de] INFO: Found listing with ID: VX66277
2026-03-28 07:35:44 [auto1.de] INFO: Found listing with ID: BB75752
2026-03-28 07:35:44 [auto1.de] INFO: Found listing with ID: RB10929
2026-03-28 07:35:44 [auto1.de] INFO: Found listing with ID: EL15513
2026-03-28 07:35:44 [auto1.de] INFO: Found listing with ID: BE37865
2026-03-28 07:35:44 [auto1.de] INFO: Found listing with ID: GV24790
2026-03-28 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV24790%27 HTTP/1.1" 200 None
2026-03-28 07:35:44 [auto1.de] INFO: Scrape type for GV24790: 0
2026-03-28 07:35:44 [auto1.de] INFO: Found listing with ID: AA02117
2026-03-28 07:35:44 [auto1.de] INFO: Found listing with ID: SU97431
2026-03-28 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU97431%27 HTTP/1.1" 200 None
2026-03-28 07:35:44 [auto1.de] INFO: Scrape type for SU97431: 2
2026-03-28 07:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d89be7a-2cdf-5add-98c7-15b762ba420a with identifier: SU97431
2026-03-28 07:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d89be7a-2cdf-5add-98c7-15b762ba420a with scrape type 2
2026-03-28 07:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d89be7a-2cdf-5add-98c7-15b762ba420a with scrape type 2
2026-03-28 07:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d89be7a-2cdf-5add-98c7-15b762ba420a, identifier: SU97431
2026-03-28 07:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d89be7a-2cdf-5add-98c7-15b762ba420a with identifier: SU97431
2026-03-28 07:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d89be7a-2cdf-5add-98c7-15b762ba420a with identifier: SU97431
2026-03-28 07:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d89be7a-2cdf-5add-98c7-15b762ba420a with identifier: SU97431 to the API
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 129,
'expiration_date': '2026-03-28T16:25:40Z',
'fuel_type': 'petrol',
'id': '7d89be7a-2cdf-5add-98c7-15b762ba420a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU97431',
'listing': 'auction',
'make': 'Jeep',
'model': 'Compass',
'odometer': 23084,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-31',
'seller_name': None,
'title': 'Jeep Compass 1.5 GSE T4 e-Hybrid Night Eagle FWD',
'transmission': 'automatic',
'trim': 'Night Eagle FWD',
'year': 2023}
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU97431%27 HTTP/1.1" 200 None
2026-03-28 07:35:45 [auto1.de] INFO: Saving data for SU97431: {'auction_closing_time': 1774715140.0, 'created_time': 1774467681.923898, 'last_price_update_time': 1774683345.293499}
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU97431') HTTP/1.1" 204 0
2026-03-28 07:35:45 [auto1.de] INFO: Found listing with ID: SJ86823
2026-03-28 07:35:45 [auto1.de] INFO: Found listing with ID: XZ80184
2026-03-28 07:35:45 [auto1.de] INFO: Found listing with ID: NS70849
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS70849%27 HTTP/1.1" 200 None
2026-03-28 07:35:45 [auto1.de] INFO: Scrape type for NS70849: 0
2026-03-28 07:35:45 [auto1.de] INFO: Found listing with ID: ZF90785
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF90785%27 HTTP/1.1" 200 None
2026-03-28 07:35:45 [auto1.de] INFO: Scrape type for ZF90785: 0
2026-03-28 07:35:45 [auto1.de] INFO: Found listing with ID: VX15000
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX15000%27 HTTP/1.1" 200 None
2026-03-28 07:35:45 [auto1.de] INFO: Scrape type for VX15000: 0
2026-03-28 07:35:45 [auto1.de] INFO: Found listing with ID: GP51980
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP51980%27 HTTP/1.1" 200 None
2026-03-28 07:35:45 [auto1.de] INFO: Scrape type for GP51980: 0
2026-03-28 07:35:45 [auto1.de] INFO: Found listing with ID: XA96250
2026-03-28 07:35:45 [auto1.de] INFO: Found listing with ID: AP31336
2026-03-28 07:35:45 [auto1.de] INFO: Found listing with ID: DV16479
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV16479%27 HTTP/1.1" 200 None
2026-03-28 07:35:45 [auto1.de] INFO: Scrape type for DV16479: 0
2026-03-28 07:35:45 [auto1.de] INFO: Found listing with ID: BB98458
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB98458%27 HTTP/1.1" 200 None
2026-03-28 07:35:45 [auto1.de] INFO: Scrape type for BB98458: 0
2026-03-28 07:35:45 [auto1.de] INFO: Found listing with ID: JH14314
2026-03-28 07:35:45 [auto1.de] INFO: Found listing with ID: KE01468
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE01468%27 HTTP/1.1" 200 None
2026-03-28 07:35:45 [auto1.de] INFO: Scrape type for KE01468: 0
2026-03-28 07:35:45 [auto1.de] INFO: Found listing with ID: VV42849
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV42849%27 HTTP/1.1" 200 None
2026-03-28 07:35:45 [auto1.de] INFO: Scrape type for VV42849: 0
2026-03-28 07:35:45 [auto1.de] INFO: Found listing with ID: KD57874
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD57874%27 HTTP/1.1" 200 None
2026-03-28 07:35:45 [auto1.de] INFO: Scrape type for KD57874: 0
2026-03-28 07:35:45 [auto1.de] INFO: Found listing with ID: PB20656
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB20656%27 HTTP/1.1" 200 None
2026-03-28 07:35:45 [auto1.de] INFO: Scrape type for PB20656: 2
2026-03-28 07:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5dd3f95-6b3f-50f6-be07-269dd04c931c with identifier: PB20656
2026-03-28 07:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5dd3f95-6b3f-50f6-be07-269dd04c931c with scrape type 2
2026-03-28 07:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5dd3f95-6b3f-50f6-be07-269dd04c931c with scrape type 2
2026-03-28 07:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5dd3f95-6b3f-50f6-be07-269dd04c931c, identifier: PB20656
2026-03-28 07:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5dd3f95-6b3f-50f6-be07-269dd04c931c with identifier: PB20656
2026-03-28 07:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5dd3f95-6b3f-50f6-be07-269dd04c931c with identifier: PB20656
2026-03-28 07:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5dd3f95-6b3f-50f6-be07-269dd04c931c with identifier: PB20656 to the API
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-28T16:15:41Z',
'fuel_type': 'petrol',
'id': 'a5dd3f95-6b3f-50f6-be07-269dd04c931c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB20656',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 211202,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-15',
'seller_name': None,
'title': 'Volkswagen Passat 1.8 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2012}
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB20656%27 HTTP/1.1" 200 None
2026-03-28 07:35:45 [auto1.de] INFO: Saving data for PB20656: {'auction_closing_time': 1774714541.0, 'created_time': 1774466751.977105, 'last_price_update_time': 1774683345.984652}
2026-03-28 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB20656') HTTP/1.1" 204 0
2026-03-28 07:35:46 [auto1.de] INFO: Found listing with ID: VH78915
2026-03-28 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH78915%27 HTTP/1.1" 200 None
2026-03-28 07:35:46 [auto1.de] INFO: Scrape type for VH78915: 0
2026-03-28 07:35:46 [auto1.de] INFO: Found listing with ID: FJ59032
2026-03-28 07:35:46 [auto1.de] INFO: Found listing with ID: CM15300
2026-03-28 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM15300%27 HTTP/1.1" 200 None
2026-03-28 07:35:46 [auto1.de] INFO: Scrape type for CM15300: 0
2026-03-28 07:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:35:47 [auto1.de] INFO: Channel: 24h | Page: 61 | totalHits: 9254 | hits on page: 40
2026-03-28 07:35:47 [auto1.de] INFO: Found listing with ID: JB80015
2026-03-28 07:35:47 [auto1.de] INFO: Found listing with ID: DJ81890
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ81890%27 HTTP/1.1" 200 None
2026-03-28 07:35:47 [auto1.de] INFO: Scrape type for DJ81890: 0
2026-03-28 07:35:47 [auto1.de] INFO: Found listing with ID: TD77753
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD77753%27 HTTP/1.1" 200 None
2026-03-28 07:35:47 [auto1.de] INFO: Scrape type for TD77753: 0
2026-03-28 07:35:47 [auto1.de] INFO: Found listing with ID: WD61316
2026-03-28 07:35:47 [auto1.de] INFO: Found listing with ID: NK36025
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK36025%27 HTTP/1.1" 200 None
2026-03-28 07:35:47 [auto1.de] INFO: Scrape type for NK36025: 0
2026-03-28 07:35:47 [auto1.de] INFO: Found listing with ID: WH58707
2026-03-28 07:35:47 [auto1.de] INFO: Found listing with ID: SX52884
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX52884%27 HTTP/1.1" 200 None
2026-03-28 07:35:47 [auto1.de] INFO: Scrape type for SX52884: 0
2026-03-28 07:35:47 [auto1.de] INFO: Found listing with ID: XK74156
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK74156%27 HTTP/1.1" 200 None
2026-03-28 07:35:47 [auto1.de] INFO: Scrape type for XK74156: 0
2026-03-28 07:35:47 [auto1.de] INFO: Found listing with ID: VG76144
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG76144%27 HTTP/1.1" 200 None
2026-03-28 07:35:47 [auto1.de] INFO: Scrape type for VG76144: 2
2026-03-28 07:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e82f489-f8ef-5d44-bff6-03aa899fed17 with identifier: VG76144
2026-03-28 07:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e82f489-f8ef-5d44-bff6-03aa899fed17 with scrape type 2
2026-03-28 07:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e82f489-f8ef-5d44-bff6-03aa899fed17 with scrape type 2
2026-03-28 07:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e82f489-f8ef-5d44-bff6-03aa899fed17, identifier: VG76144
2026-03-28 07:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e82f489-f8ef-5d44-bff6-03aa899fed17 with identifier: VG76144
2026-03-28 07:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e82f489-f8ef-5d44-bff6-03aa899fed17 with identifier: VG76144
2026-03-28 07:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e82f489-f8ef-5d44-bff6-03aa899fed17 with identifier: VG76144 to the API
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:09:32Z',
'fuel_type': 'petrol',
'id': '1e82f489-f8ef-5d44-bff6-03aa899fed17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG76144',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 130586,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-30',
'seller_name': None,
'title': 'Fiat 500 0.9 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2011}
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG76144%27 HTTP/1.1" 200 None
2026-03-28 07:35:47 [auto1.de] INFO: Saving data for VG76144: {'auction_closing_time': 1774714172.0, 'created_time': 1774466583.645012, 'last_price_update_time': 1774683347.529201}
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG76144') HTTP/1.1" 204 0
2026-03-28 07:35:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:35:47 [auto1.de] INFO: Found listing with ID: HW97387
2026-03-28 07:35:47 [auto1.de] INFO: Found listing with ID: ZJ78917
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ78917%27 HTTP/1.1" 200 None
2026-03-28 07:35:47 [auto1.de] INFO: Scrape type for ZJ78917: 0
2026-03-28 07:35:47 [auto1.de] INFO: Found listing with ID: EB82059
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB82059%27 HTTP/1.1" 200 None
2026-03-28 07:35:47 [auto1.de] INFO: Scrape type for EB82059: 0
2026-03-28 07:35:47 [auto1.de] INFO: Found listing with ID: XA78994
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA78994%27 HTTP/1.1" 200 None
2026-03-28 07:35:47 [auto1.de] INFO: Scrape type for XA78994: 0
2026-03-28 07:35:47 [auto1.de] INFO: Found listing with ID: EB35688
2026-03-28 07:35:47 [auto1.de] INFO: Found listing with ID: GZ76571
2026-03-28 07:35:47 [auto1.de] INFO: Found listing with ID: VU26984
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU26984%27 HTTP/1.1" 200 None
2026-03-28 07:35:47 [auto1.de] INFO: Scrape type for VU26984: 2
2026-03-28 07:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 171d3404-3861-539b-8b81-33c5bc696da5 with identifier: VU26984
2026-03-28 07:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 171d3404-3861-539b-8b81-33c5bc696da5 with scrape type 2
2026-03-28 07:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 171d3404-3861-539b-8b81-33c5bc696da5 with scrape type 2
2026-03-28 07:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 171d3404-3861-539b-8b81-33c5bc696da5, identifier: VU26984
2026-03-28 07:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 171d3404-3861-539b-8b81-33c5bc696da5 with identifier: VU26984
2026-03-28 07:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 171d3404-3861-539b-8b81-33c5bc696da5 with identifier: VU26984
2026-03-28 07:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 171d3404-3861-539b-8b81-33c5bc696da5 with identifier: VU26984 to the API
2026-03-28 07:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:16:02Z',
'fuel_type': 'diesel',
'id': '171d3404-3861-539b-8b81-33c5bc696da5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU26984',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 139103,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-12',
'seller_name': None,
'title': 'Renault Scenic 1.9 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2010}
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU26984%27 HTTP/1.1" 200 None
2026-03-28 07:35:48 [auto1.de] INFO: Saving data for VU26984: {'auction_closing_time': 1774714562.0, 'created_time': 1774464584.649803, 'last_price_update_time': 1774683348.124713}
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU26984') HTTP/1.1" 204 0
2026-03-28 07:35:48 [auto1.de] INFO: Found listing with ID: TM51786
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM51786%27 HTTP/1.1" 200 None
2026-03-28 07:35:48 [auto1.de] INFO: Scrape type for TM51786: 0
2026-03-28 07:35:48 [auto1.de] INFO: Found listing with ID: JZ28158
2026-03-28 07:35:48 [auto1.de] INFO: Found listing with ID: LE56250
2026-03-28 07:35:48 [auto1.de] INFO: Found listing with ID: YA93761
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA93761%27 HTTP/1.1" 200 None
2026-03-28 07:35:48 [auto1.de] INFO: Scrape type for YA93761: 0
2026-03-28 07:35:48 [auto1.de] INFO: Found listing with ID: AD50420
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD50420%27 HTTP/1.1" 200 None
2026-03-28 07:35:48 [auto1.de] INFO: Scrape type for AD50420: 0
2026-03-28 07:35:48 [auto1.de] INFO: Found listing with ID: WG73343
2026-03-28 07:35:48 [auto1.de] INFO: Found listing with ID: TL04129
2026-03-28 07:35:48 [auto1.de] INFO: Found listing with ID: TT42996
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT42996%27 HTTP/1.1" 200 None
2026-03-28 07:35:48 [auto1.de] INFO: Scrape type for TT42996: 0
2026-03-28 07:35:48 [auto1.de] INFO: Found listing with ID: XY66672
2026-03-28 07:35:48 [auto1.de] INFO: Found listing with ID: DM07006
2026-03-28 07:35:48 [auto1.de] INFO: Found listing with ID: MX59150
2026-03-28 07:35:48 [auto1.de] INFO: Found listing with ID: BH40486
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH40486%27 HTTP/1.1" 200 None
2026-03-28 07:35:48 [auto1.de] INFO: Scrape type for BH40486: 0
2026-03-28 07:35:48 [auto1.de] INFO: Found listing with ID: TM28399
2026-03-28 07:35:48 [auto1.de] INFO: Found listing with ID: NG35588
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG35588%27 HTTP/1.1" 200 None
2026-03-28 07:35:48 [auto1.de] INFO: Scrape type for NG35588: 0
2026-03-28 07:35:48 [auto1.de] INFO: Found listing with ID: DX26542
2026-03-28 07:35:48 [auto1.de] INFO: Found listing with ID: HM43288
2026-03-28 07:35:48 [auto1.de] INFO: Found listing with ID: XY68410
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY68410%27 HTTP/1.1" 200 None
2026-03-28 07:35:48 [auto1.de] INFO: Scrape type for XY68410: 0
2026-03-28 07:35:48 [auto1.de] INFO: Found listing with ID: NC31400
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC31400%27 HTTP/1.1" 200 None
2026-03-28 07:35:48 [auto1.de] INFO: Scrape type for NC31400: 0
2026-03-28 07:35:48 [auto1.de] INFO: Found listing with ID: GW92568
2026-03-28 07:35:48 [auto1.de] INFO: Found listing with ID: BT69693
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT69693%27 HTTP/1.1" 200 None
2026-03-28 07:35:48 [auto1.de] INFO: Scrape type for BT69693: 0
2026-03-28 07:35:48 [auto1.de] INFO: Found listing with ID: ZW55395
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW55395%27 HTTP/1.1" 200 None
2026-03-28 07:35:48 [auto1.de] INFO: Scrape type for ZW55395: 0
2026-03-28 07:35:48 [auto1.de] INFO: Found listing with ID: XP03484
2026-03-28 07:35:48 [auto1.de] INFO: Found listing with ID: WM91773
2026-03-28 07:35:48 [auto1.de] INFO: Found listing with ID: SF00674
2026-03-28 07:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:35:49 [auto1.de] INFO: Channel: 24h | Page: 62 | totalHits: 9254 | hits on page: 40
2026-03-28 07:35:49 [auto1.de] INFO: Found listing with ID: RP81387
2026-03-28 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP81387%27 HTTP/1.1" 200 None
2026-03-28 07:35:49 [auto1.de] INFO: Scrape type for RP81387: 0
2026-03-28 07:35:49 [auto1.de] INFO: Found listing with ID: GJ26621
2026-03-28 07:35:49 [auto1.de] INFO: Found listing with ID: KW54654
2026-03-28 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW54654%27 HTTP/1.1" 200 None
2026-03-28 07:35:49 [auto1.de] INFO: Scrape type for KW54654: 2
2026-03-28 07:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 082c068c-52c4-586e-9e1f-dc307ca1b206 with identifier: KW54654
2026-03-28 07:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 082c068c-52c4-586e-9e1f-dc307ca1b206 with scrape type 2
2026-03-28 07:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 082c068c-52c4-586e-9e1f-dc307ca1b206 with scrape type 2
2026-03-28 07:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 082c068c-52c4-586e-9e1f-dc307ca1b206, identifier: KW54654
2026-03-28 07:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 082c068c-52c4-586e-9e1f-dc307ca1b206 with identifier: KW54654
2026-03-28 07:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 082c068c-52c4-586e-9e1f-dc307ca1b206 with identifier: KW54654
2026-03-28 07:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 082c068c-52c4-586e-9e1f-dc307ca1b206 with identifier: KW54654 to the API
2026-03-28 07:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:04:07Z',
'fuel_type': 'diesel',
'id': '082c068c-52c4-586e-9e1f-dc307ca1b206',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW54654',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 200490,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-29',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Allstar BlueMotion Tech',
'transmission': 'manual',
'trim': 'Allstar BlueMotion Tech',
'year': 2016}
2026-03-28 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW54654%27 HTTP/1.1" 200 None
2026-03-28 07:35:49 [auto1.de] INFO: Saving data for KW54654: {'auction_closing_time': 1774713847.0, 'created_time': 1774503034.221448, 'last_price_update_time': 1774683349.672417}
2026-03-28 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KW54654') HTTP/1.1" 204 0
2026-03-28 07:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:35:49 [auto1.de] INFO: Found listing with ID: CA74097
2026-03-28 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA74097%27 HTTP/1.1" 200 None
2026-03-28 07:35:49 [auto1.de] INFO: Scrape type for CA74097: 2
2026-03-28 07:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1466d35-ecad-539b-8e5f-70a32cba54c9 with identifier: CA74097
2026-03-28 07:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1466d35-ecad-539b-8e5f-70a32cba54c9 with scrape type 2
2026-03-28 07:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1466d35-ecad-539b-8e5f-70a32cba54c9 with scrape type 2
2026-03-28 07:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1466d35-ecad-539b-8e5f-70a32cba54c9, identifier: CA74097
2026-03-28 07:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1466d35-ecad-539b-8e5f-70a32cba54c9 with identifier: CA74097
2026-03-28 07:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1466d35-ecad-539b-8e5f-70a32cba54c9 with identifier: CA74097
2026-03-28 07:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1466d35-ecad-539b-8e5f-70a32cba54c9 with identifier: CA74097 to the API
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:53:21Z',
'fuel_type': 'diesel',
'id': 'c1466d35-ecad-539b-8e5f-70a32cba54c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA74097',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 176890,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-27',
'seller_name': None,
'title': 'BMW 2er 220d Gran Tourer Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2016}
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA74097%27 HTTP/1.1" 200 None
2026-03-28 07:35:50 [auto1.de] INFO: Saving data for CA74097: {'auction_closing_time': 1774716801.0, 'created_time': 1774033228.266557, 'last_price_update_time': 1774683350.23016}
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA74097') HTTP/1.1" 204 0
2026-03-28 07:35:50 [auto1.de] INFO: Found listing with ID: US56828
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US56828%27 HTTP/1.1" 200 None
2026-03-28 07:35:50 [auto1.de] INFO: Scrape type for US56828: 0
2026-03-28 07:35:50 [auto1.de] INFO: Found listing with ID: PL21406
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL21406%27 HTTP/1.1" 200 None
2026-03-28 07:35:50 [auto1.de] INFO: Scrape type for PL21406: 0
2026-03-28 07:35:50 [auto1.de] INFO: Found listing with ID: NK11674
2026-03-28 07:35:50 [auto1.de] INFO: Found listing with ID: CM53141
2026-03-28 07:35:50 [auto1.de] INFO: Found listing with ID: YF83058
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF83058%27 HTTP/1.1" 200 None
2026-03-28 07:35:50 [auto1.de] INFO: Scrape type for YF83058: 0
2026-03-28 07:35:50 [auto1.de] INFO: Found listing with ID: MT08770
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT08770%27 HTTP/1.1" 200 None
2026-03-28 07:35:50 [auto1.de] INFO: Scrape type for MT08770: 0
2026-03-28 07:35:50 [auto1.de] INFO: Found listing with ID: XS50752
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50752%27 HTTP/1.1" 200 None
2026-03-28 07:35:50 [auto1.de] INFO: Scrape type for XS50752: 0
2026-03-28 07:35:50 [auto1.de] INFO: Found listing with ID: TS13333
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS13333%27 HTTP/1.1" 200 None
2026-03-28 07:35:50 [auto1.de] INFO: Scrape type for TS13333: 2
2026-03-28 07:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29603b69-fccf-5ff6-8a0c-5dfdca1bacce with identifier: TS13333
2026-03-28 07:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29603b69-fccf-5ff6-8a0c-5dfdca1bacce with scrape type 2
2026-03-28 07:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29603b69-fccf-5ff6-8a0c-5dfdca1bacce with scrape type 2
2026-03-28 07:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29603b69-fccf-5ff6-8a0c-5dfdca1bacce, identifier: TS13333
2026-03-28 07:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29603b69-fccf-5ff6-8a0c-5dfdca1bacce with identifier: TS13333
2026-03-28 07:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29603b69-fccf-5ff6-8a0c-5dfdca1bacce with identifier: TS13333
2026-03-28 07:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29603b69-fccf-5ff6-8a0c-5dfdca1bacce with identifier: TS13333 to the API
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-28T16:20:33Z',
'fuel_type': 'diesel',
'id': '29603b69-fccf-5ff6-8a0c-5dfdca1bacce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS13333',
'listing': 'auction',
'make': 'Citroen',
'model': 'C-Crosser',
'odometer': 242683,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-28',
'seller_name': None,
'title': 'Citroen C-Crosser 2.2 HDi Exclusive',
'transmission': 'automatic',
'trim': 'Exclusive',
'year': 2010}
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS13333%27 HTTP/1.1" 200 None
2026-03-28 07:35:50 [auto1.de] INFO: Saving data for TS13333: {'auction_closing_time': 1774714833.0, 'created_time': 1774465690.335436, 'last_price_update_time': 1774683350.789856}
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS13333') HTTP/1.1" 204 0
2026-03-28 07:35:50 [auto1.de] INFO: Found listing with ID: FM78793
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM78793%27 HTTP/1.1" 200 None
2026-03-28 07:35:50 [auto1.de] INFO: Scrape type for FM78793: 0
2026-03-28 07:35:50 [auto1.de] INFO: Found listing with ID: KL09374
2026-03-28 07:35:50 [auto1.de] INFO: Found listing with ID: LC07612
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC07612%27 HTTP/1.1" 200 None
2026-03-28 07:35:50 [auto1.de] INFO: Scrape type for LC07612: 0
2026-03-28 07:35:50 [auto1.de] INFO: Found listing with ID: BC57293
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC57293%27 HTTP/1.1" 200 None
2026-03-28 07:35:50 [auto1.de] INFO: Scrape type for BC57293: 2
2026-03-28 07:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1102a0ca-5dc7-5bb0-a020-b398d55e47d7 with identifier: BC57293
2026-03-28 07:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1102a0ca-5dc7-5bb0-a020-b398d55e47d7 with scrape type 2
2026-03-28 07:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1102a0ca-5dc7-5bb0-a020-b398d55e47d7 with scrape type 2
2026-03-28 07:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1102a0ca-5dc7-5bb0-a020-b398d55e47d7, identifier: BC57293
2026-03-28 07:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1102a0ca-5dc7-5bb0-a020-b398d55e47d7 with identifier: BC57293
2026-03-28 07:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1102a0ca-5dc7-5bb0-a020-b398d55e47d7 with identifier: BC57293
2026-03-28 07:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1102a0ca-5dc7-5bb0-a020-b398d55e47d7 with identifier: BC57293 to the API
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:43:59Z',
'fuel_type': 'diesel',
'id': '1102a0ca-5dc7-5bb0-a020-b398d55e47d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC57293',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 322042,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-12-14',
'seller_name': None,
'title': 'Audi A6 2.5 V6 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2004}
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC57293%27 HTTP/1.1" 200 None
2026-03-28 07:35:51 [auto1.de] INFO: Saving data for BC57293: {'auction_closing_time': 1774716239.0, 'created_time': 1774466846.460746, 'last_price_update_time': 1774683351.260403}
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC57293') HTTP/1.1" 204 0
2026-03-28 07:35:51 [auto1.de] INFO: Found listing with ID: XK59182
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK59182%27 HTTP/1.1" 200 None
2026-03-28 07:35:51 [auto1.de] INFO: Scrape type for XK59182: 0
2026-03-28 07:35:51 [auto1.de] INFO: Found listing with ID: YH55403
2026-03-28 07:35:51 [auto1.de] INFO: Found listing with ID: WB12349
2026-03-28 07:35:51 [auto1.de] INFO: Found listing with ID: YS42401
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS42401%27 HTTP/1.1" 200 None
2026-03-28 07:35:51 [auto1.de] INFO: Scrape type for YS42401: 0
2026-03-28 07:35:51 [auto1.de] INFO: Found listing with ID: PF56750
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF56750%27 HTTP/1.1" 200 None
2026-03-28 07:35:51 [auto1.de] INFO: Scrape type for PF56750: 0
2026-03-28 07:35:51 [auto1.de] INFO: Found listing with ID: SS34696
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS34696%27 HTTP/1.1" 200 None
2026-03-28 07:35:51 [auto1.de] INFO: Scrape type for SS34696: 0
2026-03-28 07:35:51 [auto1.de] INFO: Found listing with ID: ED19877
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED19877%27 HTTP/1.1" 200 None
2026-03-28 07:35:51 [auto1.de] INFO: Scrape type for ED19877: 2
2026-03-28 07:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12d34e8f-a588-5e90-8815-be225187027f with identifier: ED19877
2026-03-28 07:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12d34e8f-a588-5e90-8815-be225187027f with scrape type 2
2026-03-28 07:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12d34e8f-a588-5e90-8815-be225187027f with scrape type 2
2026-03-28 07:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12d34e8f-a588-5e90-8815-be225187027f, identifier: ED19877
2026-03-28 07:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12d34e8f-a588-5e90-8815-be225187027f with identifier: ED19877
2026-03-28 07:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12d34e8f-a588-5e90-8815-be225187027f with identifier: ED19877
2026-03-28 07:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12d34e8f-a588-5e90-8815-be225187027f with identifier: ED19877 to the API
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:46:27Z',
'fuel_type': 'diesel',
'id': '12d34e8f-a588-5e90-8815-be225187027f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED19877',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 251016,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-10',
'seller_name': None,
'title': 'Opel Zafira Tourer 2.0 CDTI Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2014}
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED19877%27 HTTP/1.1" 200 None
2026-03-28 07:35:51 [auto1.de] INFO: Saving data for ED19877: {'auction_closing_time': 1774716387.0, 'created_time': 1774465964.702623, 'last_price_update_time': 1774683351.837814}
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED19877') HTTP/1.1" 204 0
2026-03-28 07:35:51 [auto1.de] INFO: Found listing with ID: ZC19539
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC19539%27 HTTP/1.1" 200 None
2026-03-28 07:35:51 [auto1.de] INFO: Scrape type for ZC19539: 0
2026-03-28 07:35:51 [auto1.de] INFO: Found listing with ID: TP76478
2026-03-28 07:35:51 [auto1.de] INFO: Found listing with ID: XB58662
2026-03-28 07:35:51 [auto1.de] INFO: Found listing with ID: HK09580
2026-03-28 07:35:51 [auto1.de] INFO: Found listing with ID: YK76722
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK76722%27 HTTP/1.1" 200 None
2026-03-28 07:35:51 [auto1.de] INFO: Scrape type for YK76722: 0
2026-03-28 07:35:51 [auto1.de] INFO: Found listing with ID: VH44928
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH44928%27 HTTP/1.1" 200 None
2026-03-28 07:35:51 [auto1.de] INFO: Scrape type for VH44928: 0
2026-03-28 07:35:51 [auto1.de] INFO: Found listing with ID: HN95943
2026-03-28 07:35:51 [auto1.de] INFO: Found listing with ID: FK01435
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK01435%27 HTTP/1.1" 200 None
2026-03-28 07:35:51 [auto1.de] INFO: Scrape type for FK01435: 2
2026-03-28 07:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3f0f3f0-bbc5-5bc8-bbe3-01ef2f66f4d6 with identifier: FK01435
2026-03-28 07:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3f0f3f0-bbc5-5bc8-bbe3-01ef2f66f4d6 with scrape type 2
2026-03-28 07:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3f0f3f0-bbc5-5bc8-bbe3-01ef2f66f4d6 with scrape type 2
2026-03-28 07:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3f0f3f0-bbc5-5bc8-bbe3-01ef2f66f4d6, identifier: FK01435
2026-03-28 07:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3f0f3f0-bbc5-5bc8-bbe3-01ef2f66f4d6 with identifier: FK01435
2026-03-28 07:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3f0f3f0-bbc5-5bc8-bbe3-01ef2f66f4d6 with identifier: FK01435
2026-03-28 07:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3f0f3f0-bbc5-5bc8-bbe3-01ef2f66f4d6 with identifier: FK01435 to the API
2026-03-28 07:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:21:20Z',
'fuel_type': 'petrol',
'id': 'c3f0f3f0-bbc5-5bc8-bbe3-01ef2f66f4d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK01435',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 115323,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-25',
'seller_name': None,
'title': 'Hyundai i30 1.4 Edition+',
'transmission': 'manual',
'trim': 'Edition+',
'year': 2009}
2026-03-28 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK01435%27 HTTP/1.1" 200 None
2026-03-28 07:35:52 [auto1.de] INFO: Saving data for FK01435: {'auction_closing_time': 1774714880.0, 'created_time': 1774464705.446568, 'last_price_update_time': 1774683352.371156}
2026-03-28 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK01435') HTTP/1.1" 204 0
2026-03-28 07:35:52 [auto1.de] INFO: Found listing with ID: SM97641
2026-03-28 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM97641%27 HTTP/1.1" 200 None
2026-03-28 07:35:52 [auto1.de] INFO: Scrape type for SM97641: 0
2026-03-28 07:35:52 [auto1.de] INFO: Found listing with ID: GS84935
2026-03-28 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS84935%27 HTTP/1.1" 200 None
2026-03-28 07:35:52 [auto1.de] INFO: Scrape type for GS84935: 0
2026-03-28 07:35:52 [auto1.de] INFO: Found listing with ID: HR12459
2026-03-28 07:35:52 [auto1.de] INFO: Found listing with ID: VK72696
2026-03-28 07:35:52 [auto1.de] INFO: Found listing with ID: RM36299
2026-03-28 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM36299%27 HTTP/1.1" 200 None
2026-03-28 07:35:52 [auto1.de] INFO: Scrape type for RM36299: 0
2026-03-28 07:35:52 [auto1.de] INFO: Found listing with ID: ME12043
2026-03-28 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME12043%27 HTTP/1.1" 200 None
2026-03-28 07:35:52 [auto1.de] INFO: Scrape type for ME12043: 0
2026-03-28 07:35:52 [auto1.de] INFO: Found listing with ID: JA72326
2026-03-28 07:35:52 [auto1.de] INFO: Found listing with ID: SY16661
2026-03-28 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY16661%27 HTTP/1.1" 200 None
2026-03-28 07:35:52 [auto1.de] INFO: Scrape type for SY16661: 0
2026-03-28 07:35:52 [auto1.de] INFO: Found listing with ID: MJ50234
2026-03-28 07:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:35:53 [auto1.de] INFO: Channel: 24h | Page: 63 | totalHits: 9254 | hits on page: 40
2026-03-28 07:35:53 [auto1.de] INFO: Found listing with ID: WP19217
2026-03-28 07:35:53 [auto1.de] INFO: Found listing with ID: SC05662
2026-03-28 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC05662%27 HTTP/1.1" 200 None
2026-03-28 07:35:53 [auto1.de] INFO: Scrape type for SC05662: 0
2026-03-28 07:35:53 [auto1.de] INFO: Found listing with ID: GM22494
2026-03-28 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM22494%27 HTTP/1.1" 200 None
2026-03-28 07:35:53 [auto1.de] INFO: Scrape type for GM22494: 2
2026-03-28 07:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac897f81-ab85-594b-9275-f18cd030a3a0 with identifier: GM22494
2026-03-28 07:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac897f81-ab85-594b-9275-f18cd030a3a0 with scrape type 2
2026-03-28 07:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac897f81-ab85-594b-9275-f18cd030a3a0 with scrape type 2
2026-03-28 07:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac897f81-ab85-594b-9275-f18cd030a3a0, identifier: GM22494
2026-03-28 07:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac897f81-ab85-594b-9275-f18cd030a3a0 with identifier: GM22494
2026-03-28 07:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac897f81-ab85-594b-9275-f18cd030a3a0 with identifier: GM22494
2026-03-28 07:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac897f81-ab85-594b-9275-f18cd030a3a0 with identifier: GM22494 to the API
2026-03-28 07:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:03:08Z',
'fuel_type': 'diesel',
'id': 'ac897f81-ab85-594b-9275-f18cd030a3a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM22494',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 280167,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-04',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion',
'year': 2017}
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM22494%27 HTTP/1.1" 200 None
2026-03-28 07:35:54 [auto1.de] INFO: Saving data for GM22494: {'auction_closing_time': 1774713788.0, 'created_time': 1773484319.145316, 'last_price_update_time': 1774683354.043558}
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM22494') HTTP/1.1" 204 0
2026-03-28 07:35:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:35:54 [auto1.de] INFO: Found listing with ID: WA51646
2026-03-28 07:35:54 [auto1.de] INFO: Found listing with ID: FX28267
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX28267%27 HTTP/1.1" 200 None
2026-03-28 07:35:54 [auto1.de] INFO: Scrape type for FX28267: 0
2026-03-28 07:35:54 [auto1.de] INFO: Found listing with ID: BG36952
2026-03-28 07:35:54 [auto1.de] INFO: Found listing with ID: ZL47575
2026-03-28 07:35:54 [auto1.de] INFO: Found listing with ID: VG80520
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG80520%27 HTTP/1.1" 200 None
2026-03-28 07:35:54 [auto1.de] INFO: Scrape type for VG80520: 2
2026-03-28 07:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2be6f2b8-58f0-59c7-b988-9392628dfca8 with identifier: VG80520
2026-03-28 07:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2be6f2b8-58f0-59c7-b988-9392628dfca8 with scrape type 2
2026-03-28 07:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2be6f2b8-58f0-59c7-b988-9392628dfca8 with scrape type 2
2026-03-28 07:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2be6f2b8-58f0-59c7-b988-9392628dfca8, identifier: VG80520
2026-03-28 07:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2be6f2b8-58f0-59c7-b988-9392628dfca8 with identifier: VG80520
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 07:35:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2be6f2b8-58f0-59c7-b988-9392628dfca8 with identifier: VG80520
2026-03-28 07:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2be6f2b8-58f0-59c7-b988-9392628dfca8 with identifier: VG80520 to the API
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:35:49Z',
'fuel_type': 'petrol',
'id': '2be6f2b8-58f0-59c7-b988-9392628dfca8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG80520',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 145555,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-28',
'seller_name': None,
'title': 'Peugeot 207 1.6 Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2009}
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG80520%27 HTTP/1.1" 200 None
2026-03-28 07:35:54 [auto1.de] INFO: Saving data for VG80520: {'auction_closing_time': 1774715749.0, 'created_time': 1774464417.978038, 'last_price_update_time': 1774683354.695986}
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG80520') HTTP/1.1" 204 0
2026-03-28 07:35:54 [auto1.de] INFO: Found listing with ID: VB40940
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB40940%27 HTTP/1.1" 200 None
2026-03-28 07:35:54 [auto1.de] INFO: Scrape type for VB40940: 0
2026-03-28 07:35:54 [auto1.de] INFO: Found listing with ID: EY08690
2026-03-28 07:35:54 [auto1.de] INFO: Found listing with ID: VE85769
2026-03-28 07:35:54 [auto1.de] INFO: Found listing with ID: LZ61913
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ61913%27 HTTP/1.1" 200 None
2026-03-28 07:35:54 [auto1.de] INFO: Scrape type for LZ61913: 0
2026-03-28 07:35:54 [auto1.de] INFO: Found listing with ID: XT31458
2026-03-28 07:35:54 [auto1.de] INFO: Found listing with ID: ZG52180
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG52180%27 HTTP/1.1" 200 None
2026-03-28 07:35:54 [auto1.de] INFO: Scrape type for ZG52180: 0
2026-03-28 07:35:54 [auto1.de] INFO: Found listing with ID: HT24863
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT24863%27 HTTP/1.1" 200 None
2026-03-28 07:35:54 [auto1.de] INFO: Scrape type for HT24863: 0
2026-03-28 07:35:54 [auto1.de] INFO: Found listing with ID: DS04882
2026-03-28 07:35:54 [auto1.de] INFO: Found listing with ID: EU98596
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU98596%27 HTTP/1.1" 200 None
2026-03-28 07:35:54 [auto1.de] INFO: Scrape type for EU98596: 0
2026-03-28 07:35:54 [auto1.de] INFO: Found listing with ID: CW96220
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW96220%27 HTTP/1.1" 200 None
2026-03-28 07:35:54 [auto1.de] INFO: Scrape type for CW96220: 0
2026-03-28 07:35:54 [auto1.de] INFO: Found listing with ID: ZU82710
2026-03-28 07:35:54 [auto1.de] INFO: Found listing with ID: AZ05535
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ05535%27 HTTP/1.1" 200 None
2026-03-28 07:35:54 [auto1.de] INFO: Scrape type for AZ05535: 0
2026-03-28 07:35:54 [auto1.de] INFO: Found listing with ID: EA35608
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA35608%27 HTTP/1.1" 200 None
2026-03-28 07:35:54 [auto1.de] INFO: Scrape type for EA35608: 0
2026-03-28 07:35:54 [auto1.de] INFO: Found listing with ID: AL17067
2026-03-28 07:35:54 [auto1.de] INFO: Found listing with ID: WE17641
2026-03-28 07:35:54 [auto1.de] INFO: Found listing with ID: LZ26330
2026-03-28 07:35:54 [auto1.de] INFO: Found listing with ID: BP83751
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP83751%27 HTTP/1.1" 200 None
2026-03-28 07:35:54 [auto1.de] INFO: Scrape type for BP83751: 2
2026-03-28 07:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e4b394b-272e-5a9b-93a2-03ed093c7254 with identifier: BP83751
2026-03-28 07:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e4b394b-272e-5a9b-93a2-03ed093c7254 with scrape type 2
2026-03-28 07:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e4b394b-272e-5a9b-93a2-03ed093c7254 with scrape type 2
2026-03-28 07:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e4b394b-272e-5a9b-93a2-03ed093c7254, identifier: BP83751
2026-03-28 07:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e4b394b-272e-5a9b-93a2-03ed093c7254 with identifier: BP83751
2026-03-28 07:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e4b394b-272e-5a9b-93a2-03ed093c7254 with identifier: BP83751
2026-03-28 07:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e4b394b-272e-5a9b-93a2-03ed093c7254 with identifier: BP83751 to the API
2026-03-28 07:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 160,
'expiration_date': '2026-03-28T16:05:31Z',
'fuel_type': 'petrol',
'id': '9e4b394b-272e-5a9b-93a2-03ed093c7254',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP83751',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat CC',
'odometer': 202538,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-12',
'seller_name': None,
'title': 'Volkswagen Passat CC 1.8 TSI',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-28 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP83751%27 HTTP/1.1" 200 None
2026-03-28 07:35:55 [auto1.de] INFO: Saving data for BP83751: {'auction_closing_time': 1774713931.0, 'created_time': 1774465418.075144, 'last_price_update_time': 1774683355.239957}
2026-03-28 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP83751') HTTP/1.1" 204 0
2026-03-28 07:35:55 [auto1.de] INFO: Found listing with ID: NT96701
2026-03-28 07:35:55 [auto1.de] INFO: Found listing with ID: DP90284
2026-03-28 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP90284%27 HTTP/1.1" 200 None
2026-03-28 07:35:55 [auto1.de] INFO: Scrape type for DP90284: 0
2026-03-28 07:35:55 [auto1.de] INFO: Found listing with ID: AY92583
2026-03-28 07:35:55 [auto1.de] INFO: Found listing with ID: MP72809
2026-03-28 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP72809%27 HTTP/1.1" 200 None
2026-03-28 07:35:55 [auto1.de] INFO: Scrape type for MP72809: 0
2026-03-28 07:35:55 [auto1.de] INFO: Found listing with ID: KU29056
2026-03-28 07:35:55 [auto1.de] INFO: Found listing with ID: PB67262
2026-03-28 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB67262%27 HTTP/1.1" 200 None
2026-03-28 07:35:55 [auto1.de] INFO: Scrape type for PB67262: 0
2026-03-28 07:35:55 [auto1.de] INFO: Found listing with ID: DP65043
2026-03-28 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP65043%27 HTTP/1.1" 200 None
2026-03-28 07:35:55 [auto1.de] INFO: Scrape type for DP65043: 0
2026-03-28 07:35:55 [auto1.de] INFO: Found listing with ID: NN10939
2026-03-28 07:35:55 [auto1.de] INFO: Found listing with ID: FX25662
2026-03-28 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX25662%27 HTTP/1.1" 200 None
2026-03-28 07:35:55 [auto1.de] INFO: Scrape type for FX25662: 0
2026-03-28 07:35:55 [auto1.de] INFO: Found listing with ID: GU60494
2026-03-28 07:35:55 [auto1.de] INFO: Found listing with ID: VF90818
2026-03-28 07:35:55 [auto1.de] INFO: Found listing with ID: NY21217
2026-03-28 07:35:55 [auto1.de] INFO: Found listing with ID: YF48046
2026-03-28 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF48046%27 HTTP/1.1" 200 None
2026-03-28 07:35:55 [auto1.de] INFO: Scrape type for YF48046: 0
2026-03-28 07:35:55 [auto1.de] INFO: Found listing with ID: SR56375
2026-03-28 07:35:55 [auto1.de] INFO: Found listing with ID: SP68179
2026-03-28 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP68179%27 HTTP/1.1" 200 None
2026-03-28 07:35:55 [auto1.de] INFO: Scrape type for SP68179: 0
2026-03-28 07:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:35:56 [auto1.de] INFO: Channel: 24h | Page: 64 | totalHits: 9254 | hits on page: 40
2026-03-28 07:35:56 [auto1.de] INFO: Found listing with ID: RE71424
2026-03-28 07:35:56 [auto1.de] INFO: Found listing with ID: ZL30949
2026-03-28 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL30949%27 HTTP/1.1" 200 None
2026-03-28 07:35:56 [auto1.de] INFO: Scrape type for ZL30949: 0
2026-03-28 07:35:56 [auto1.de] INFO: Found listing with ID: XW98427
2026-03-28 07:35:56 [auto1.de] INFO: Found listing with ID: ML73813
2026-03-28 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML73813%27 HTTP/1.1" 200 None
2026-03-28 07:35:56 [auto1.de] INFO: Scrape type for ML73813: 0
2026-03-28 07:35:56 [auto1.de] INFO: Found listing with ID: LR49989
2026-03-28 07:35:56 [auto1.de] INFO: Found listing with ID: YV87591
2026-03-28 07:35:56 [auto1.de] INFO: Found listing with ID: HD49679
2026-03-28 07:35:56 [auto1.de] INFO: Found listing with ID: DC75837
2026-03-28 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC75837%27 HTTP/1.1" 200 None
2026-03-28 07:35:56 [auto1.de] INFO: Scrape type for DC75837: 2
2026-03-28 07:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94217a75-801c-56f7-9779-3c70cc5d8712 with identifier: DC75837
2026-03-28 07:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94217a75-801c-56f7-9779-3c70cc5d8712 with scrape type 2
2026-03-28 07:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94217a75-801c-56f7-9779-3c70cc5d8712 with scrape type 2
2026-03-28 07:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94217a75-801c-56f7-9779-3c70cc5d8712, identifier: DC75837
2026-03-28 07:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94217a75-801c-56f7-9779-3c70cc5d8712 with identifier: DC75837
2026-03-28 07:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94217a75-801c-56f7-9779-3c70cc5d8712 with identifier: DC75837
2026-03-28 07:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94217a75-801c-56f7-9779-3c70cc5d8712 with identifier: DC75837 to the API
2026-03-28 07:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 68,
'expiration_date': '2026-03-28T16:41:43Z',
'fuel_type': 'petrol',
'id': '94217a75-801c-56f7-9779-3c70cc5d8712',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC75837',
'listing': 'auction',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 88203,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-14',
'seller_name': None,
'title': 'Toyota Aygo 1.0 City',
'transmission': 'manual',
'trim': 'City',
'year': 2009}
2026-03-28 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC75837%27 HTTP/1.1" 200 None
2026-03-28 07:35:56 [auto1.de] INFO: Saving data for DC75837: {'auction_closing_time': 1774716103.0, 'created_time': 1774467688.966554, 'last_price_update_time': 1774683356.843965}
2026-03-28 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC75837') HTTP/1.1" 204 0
2026-03-28 07:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:35:56 [auto1.de] INFO: Found listing with ID: JT65336
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT65336%27 HTTP/1.1" 200 None
2026-03-28 07:35:57 [auto1.de] INFO: Scrape type for JT65336: 0
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: GB09367
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB09367%27 HTTP/1.1" 200 None
2026-03-28 07:35:57 [auto1.de] INFO: Scrape type for GB09367: 2
2026-03-28 07:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3be65556-cd53-54c7-856b-571da8160014 with identifier: GB09367
2026-03-28 07:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3be65556-cd53-54c7-856b-571da8160014 with scrape type 2
2026-03-28 07:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3be65556-cd53-54c7-856b-571da8160014 with scrape type 2
2026-03-28 07:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3be65556-cd53-54c7-856b-571da8160014, identifier: GB09367
2026-03-28 07:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3be65556-cd53-54c7-856b-571da8160014 with identifier: GB09367
2026-03-28 07:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3be65556-cd53-54c7-856b-571da8160014 with identifier: GB09367
2026-03-28 07:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3be65556-cd53-54c7-856b-571da8160014 with identifier: GB09367 to the API
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 175,
'expiration_date': '2026-03-28T16:59:23Z',
'fuel_type': 'diesel',
'id': '3be65556-cd53-54c7-856b-571da8160014',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB09367',
'listing': 'auction',
'make': 'Mazda',
'model': '6',
'odometer': 113237,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-05',
'seller_name': None,
'title': 'Mazda 6 2.2 Turbodiesel Sports-Line AWD',
'transmission': 'automatic',
'trim': 'Sports-Line AWD',
'year': 2016}
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB09367%27 HTTP/1.1" 200 None
2026-03-28 07:35:57 [auto1.de] INFO: Saving data for GB09367: {'auction_closing_time': 1774717163.0, 'created_time': 1774468183.900149, 'last_price_update_time': 1774683357.436847}
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB09367') HTTP/1.1" 204 0
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: DT42363
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: DK27317
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: WL60087
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL60087%27 HTTP/1.1" 200 None
2026-03-28 07:35:57 [auto1.de] INFO: Scrape type for WL60087: 0
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: UD38277
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD38277%27 HTTP/1.1" 200 None
2026-03-28 07:35:57 [auto1.de] INFO: Scrape type for UD38277: 0
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: CR45674
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR45674%27 HTTP/1.1" 200 None
2026-03-28 07:35:57 [auto1.de] INFO: Scrape type for CR45674: 0
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: MP23640
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: RK32817
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: FR24268
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: FB02409
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: UT71403
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: LL49213
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: RM06492
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: FL79995
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: NU80618
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: RU42318
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: MG91199
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: XB91426
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB91426%27 HTTP/1.1" 200 None
2026-03-28 07:35:57 [auto1.de] INFO: Scrape type for XB91426: 0
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: MC26208
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: GJ57760
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: MR73613
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: LX45168
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX45168%27 HTTP/1.1" 200 None
2026-03-28 07:35:57 [auto1.de] INFO: Scrape type for LX45168: 0
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: GR60102
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR60102%27 HTTP/1.1" 200 None
2026-03-28 07:35:57 [auto1.de] INFO: Scrape type for GR60102: 0
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: EF04397
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF04397%27 HTTP/1.1" 200 None
2026-03-28 07:35:57 [auto1.de] INFO: Scrape type for EF04397: 0
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: XR86863
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: UW93574
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW93574%27 HTTP/1.1" 200 None
2026-03-28 07:35:57 [auto1.de] INFO: Scrape type for UW93574: 0
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: BE24372
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: MX91312
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX91312%27 HTTP/1.1" 200 None
2026-03-28 07:35:57 [auto1.de] INFO: Scrape type for MX91312: 0
2026-03-28 07:35:57 [auto1.de] INFO: Found listing with ID: JY81419
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY81419%27 HTTP/1.1" 200 None
2026-03-28 07:35:57 [auto1.de] INFO: Scrape type for JY81419: 2
2026-03-28 07:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73008f18-d7ba-529d-bdd4-b69f4692ab43 with identifier: JY81419
2026-03-28 07:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73008f18-d7ba-529d-bdd4-b69f4692ab43 with scrape type 2
2026-03-28 07:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73008f18-d7ba-529d-bdd4-b69f4692ab43 with scrape type 2
2026-03-28 07:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73008f18-d7ba-529d-bdd4-b69f4692ab43, identifier: JY81419
2026-03-28 07:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73008f18-d7ba-529d-bdd4-b69f4692ab43 with identifier: JY81419
2026-03-28 07:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73008f18-d7ba-529d-bdd4-b69f4692ab43 with identifier: JY81419
2026-03-28 07:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73008f18-d7ba-529d-bdd4-b69f4692ab43 with identifier: JY81419 to the API
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 299,
'expiration_date': '2026-03-28T16:57:17Z',
'fuel_type': 'hybrid',
'id': '73008f18-d7ba-529d-bdd4-b69f4692ab43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY81419',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'S-Klasse',
'odometer': 143707,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-23',
'seller_name': None,
'title': 'Mercedes-Benz S-Klasse S 400 Hybrid',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-28 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY81419%27 HTTP/1.1" 200 None
2026-03-28 07:35:58 [auto1.de] INFO: Saving data for JY81419: {'auction_closing_time': 1774717037.0, 'created_time': 1774467012.214994, 'last_price_update_time': 1774683358.03689}
2026-03-28 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY81419') HTTP/1.1" 204 0
2026-03-28 07:35:58 [auto1.de] INFO: Found listing with ID: PS82171
2026-03-28 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82171%27 HTTP/1.1" 200 None
2026-03-28 07:35:58 [auto1.de] INFO: Scrape type for PS82171: 0
2026-03-28 07:35:58 [auto1.de] INFO: Found listing with ID: JM51025
2026-03-28 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM51025%27 HTTP/1.1" 200 None
2026-03-28 07:35:58 [auto1.de] INFO: Scrape type for JM51025: 0
2026-03-28 07:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:35:59 [auto1.de] INFO: Channel: 24h | Page: 65 | totalHits: 9255 | hits on page: 40
2026-03-28 07:35:59 [auto1.de] INFO: Found listing with ID: JM51025
2026-03-28 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM51025%27 HTTP/1.1" 200 None
2026-03-28 07:35:59 [auto1.de] INFO: Scrape type for JM51025: 0
2026-03-28 07:35:59 [auto1.de] INFO: Found listing with ID: EZ23867
2026-03-28 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ23867%27 HTTP/1.1" 200 None
2026-03-28 07:35:59 [auto1.de] INFO: Scrape type for EZ23867: 0
2026-03-28 07:35:59 [auto1.de] INFO: Found listing with ID: FA60427
2026-03-28 07:35:59 [auto1.de] INFO: Found listing with ID: KD74504
2026-03-28 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD74504%27 HTTP/1.1" 200 None
2026-03-28 07:35:59 [auto1.de] INFO: Scrape type for KD74504: 2
2026-03-28 07:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edf8f50f-25bc-535c-bd56-d24dae515505 with identifier: KD74504
2026-03-28 07:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edf8f50f-25bc-535c-bd56-d24dae515505 with scrape type 2
2026-03-28 07:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edf8f50f-25bc-535c-bd56-d24dae515505 with scrape type 2
2026-03-28 07:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edf8f50f-25bc-535c-bd56-d24dae515505, identifier: KD74504
2026-03-28 07:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edf8f50f-25bc-535c-bd56-d24dae515505 with identifier: KD74504
2026-03-28 07:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edf8f50f-25bc-535c-bd56-d24dae515505 with identifier: KD74504
2026-03-28 07:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edf8f50f-25bc-535c-bd56-d24dae515505 with identifier: KD74504 to the API
2026-03-28 07:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 60,
'expiration_date': '2026-03-28T16:49:01Z',
'fuel_type': 'petrol',
'id': 'edf8f50f-25bc-535c-bd56-d24dae515505',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD74504',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 213785,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-02',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2011}
2026-03-28 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD74504%27 HTTP/1.1" 200 None
2026-03-28 07:35:59 [auto1.de] INFO: Saving data for KD74504: {'auction_closing_time': 1774716541.0, 'created_time': 1774468072.085592, 'last_price_update_time': 1774683359.51753}
2026-03-28 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD74504') HTTP/1.1" 204 0
2026-03-28 07:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:35:59 [auto1.de] INFO: Found listing with ID: LE46493
2026-03-28 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE46493%27 HTTP/1.1" 200 None
2026-03-28 07:35:59 [auto1.de] INFO: Scrape type for LE46493: 0
2026-03-28 07:35:59 [auto1.de] INFO: Found listing with ID: RK40243
2026-03-28 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK40243%27 HTTP/1.1" 200 None
2026-03-28 07:35:59 [auto1.de] INFO: Scrape type for RK40243: 2
2026-03-28 07:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77b83a14-17a6-57db-a321-b8c420ae8ade with identifier: RK40243
2026-03-28 07:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77b83a14-17a6-57db-a321-b8c420ae8ade with scrape type 2
2026-03-28 07:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77b83a14-17a6-57db-a321-b8c420ae8ade with scrape type 2
2026-03-28 07:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77b83a14-17a6-57db-a321-b8c420ae8ade, identifier: RK40243
2026-03-28 07:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77b83a14-17a6-57db-a321-b8c420ae8ade with identifier: RK40243
2026-03-28 07:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77b83a14-17a6-57db-a321-b8c420ae8ade with identifier: RK40243
2026-03-28 07:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77b83a14-17a6-57db-a321-b8c420ae8ade with identifier: RK40243 to the API
2026-03-28 07:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:08:06Z',
'fuel_type': 'diesel',
'id': '77b83a14-17a6-57db-a321-b8c420ae8ade',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK40243',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Viano',
'odometer': 144393,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-10',
'seller_name': None,
'title': 'Mercedes-Benz Viano 2.1 CDI lang Trend Edition',
'transmission': 'automatic',
'trim': 'lang Trend Edition',
'year': 2013}
2026-03-28 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK40243%27 HTTP/1.1" 200 None
2026-03-28 07:35:59 [auto1.de] INFO: Saving data for RK40243: {'auction_closing_time': 1774714086.0, 'created_time': 1774463641.032372, 'last_price_update_time': 1774683359.970509}
2026-03-28 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RK40243') HTTP/1.1" 204 0
2026-03-28 07:35:59 [auto1.de] INFO: Found listing with ID: PJ34004
2026-03-28 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34004%27 HTTP/1.1" 200 None
2026-03-28 07:36:00 [auto1.de] INFO: Scrape type for PJ34004: 0
2026-03-28 07:36:00 [auto1.de] INFO: Found listing with ID: FH98757
2026-03-28 07:36:00 [auto1.de] INFO: Found listing with ID: EC42355
2026-03-28 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC42355%27 HTTP/1.1" 200 None
2026-03-28 07:36:00 [auto1.de] INFO: Scrape type for EC42355: 0
2026-03-28 07:36:00 [auto1.de] INFO: Found listing with ID: LT09542
2026-03-28 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT09542%27 HTTP/1.1" 200 None
2026-03-28 07:36:00 [auto1.de] INFO: Scrape type for LT09542: 0
2026-03-28 07:36:00 [auto1.de] INFO: Found listing with ID: GY11970
2026-03-28 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY11970%27 HTTP/1.1" 200 None
2026-03-28 07:36:00 [auto1.de] INFO: Scrape type for GY11970: 0
2026-03-28 07:36:00 [auto1.de] INFO: Found listing with ID: YS11001
2026-03-28 07:36:00 [auto1.de] INFO: Found listing with ID: WP33305
2026-03-28 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP33305%27 HTTP/1.1" 200 None
2026-03-28 07:36:00 [auto1.de] INFO: Scrape type for WP33305: 2
2026-03-28 07:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0deadc9a-2f2c-598e-b2cb-d90f3cd71265 with identifier: WP33305
2026-03-28 07:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0deadc9a-2f2c-598e-b2cb-d90f3cd71265 with scrape type 2
2026-03-28 07:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0deadc9a-2f2c-598e-b2cb-d90f3cd71265 with scrape type 2
2026-03-28 07:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0deadc9a-2f2c-598e-b2cb-d90f3cd71265, identifier: WP33305
2026-03-28 07:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0deadc9a-2f2c-598e-b2cb-d90f3cd71265 with identifier: WP33305
2026-03-28 07:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0deadc9a-2f2c-598e-b2cb-d90f3cd71265 with identifier: WP33305
2026-03-28 07:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0deadc9a-2f2c-598e-b2cb-d90f3cd71265 with identifier: WP33305 to the API
2026-03-28 07:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 575,
'expiration_date': '2026-03-28T16:27:48Z',
'fuel_type': 'petrol',
'id': '0deadc9a-2f2c-598e-b2cb-d90f3cd71265',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP33305',
'listing': 'auction',
'make': 'BMW',
'model': 'X6',
'odometer': 114017,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-05',
'seller_name': None,
'title': 'BMW X6 M',
'transmission': 'automatic',
'trim': 'BW',
'year': 2015}
2026-03-28 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP33305%27 HTTP/1.1" 200 None
2026-03-28 07:36:00 [auto1.de] INFO: Saving data for WP33305: {'auction_closing_time': 1774715268.0, 'created_time': 1773134914.126513, 'last_price_update_time': 1774683360.512528}
2026-03-28 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP33305') HTTP/1.1" 204 0
2026-03-28 07:36:00 [auto1.de] INFO: Found listing with ID: BU76386
2026-03-28 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU76386%27 HTTP/1.1" 200 None
2026-03-28 07:36:00 [auto1.de] INFO: Scrape type for BU76386: 0
2026-03-28 07:36:00 [auto1.de] INFO: Found listing with ID: SC67475
2026-03-28 07:36:00 [auto1.de] INFO: Found listing with ID: JK59865
2026-03-28 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK59865%27 HTTP/1.1" 200 None
2026-03-28 07:36:00 [auto1.de] INFO: Scrape type for JK59865: 2
2026-03-28 07:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0606d5b3-c353-5896-ab26-f0f91c6ebf46 with identifier: JK59865
2026-03-28 07:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0606d5b3-c353-5896-ab26-f0f91c6ebf46 with scrape type 2
2026-03-28 07:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0606d5b3-c353-5896-ab26-f0f91c6ebf46 with scrape type 2
2026-03-28 07:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0606d5b3-c353-5896-ab26-f0f91c6ebf46, identifier: JK59865
2026-03-28 07:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0606d5b3-c353-5896-ab26-f0f91c6ebf46 with identifier: JK59865
2026-03-28 07:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0606d5b3-c353-5896-ab26-f0f91c6ebf46 with identifier: JK59865
2026-03-28 07:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0606d5b3-c353-5896-ab26-f0f91c6ebf46 with identifier: JK59865 to the API
2026-03-28 07:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 220,
'expiration_date': '2026-03-28T16:57:04Z',
'fuel_type': 'petrol',
'id': '0606d5b3-c353-5896-ab26-f0f91c6ebf46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK59865',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 196085,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-04-24',
'seller_name': None,
'title': 'Audi A6 3.0 V6 quattro',
'transmission': 'manual',
'trim': 'quattro',
'year': 2003}
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK59865%27 HTTP/1.1" 200 None
2026-03-28 07:36:01 [auto1.de] INFO: Saving data for JK59865: {'auction_closing_time': 1774717024.0, 'created_time': 1774467619.078376, 'last_price_update_time': 1774683361.089767}
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK59865') HTTP/1.1" 204 0
2026-03-28 07:36:01 [auto1.de] INFO: Found listing with ID: JN76212
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN76212%27 HTTP/1.1" 200 None
2026-03-28 07:36:01 [auto1.de] INFO: Scrape type for JN76212: 0
2026-03-28 07:36:01 [auto1.de] INFO: Found listing with ID: JJ18730
2026-03-28 07:36:01 [auto1.de] INFO: Found listing with ID: RZ53370
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ53370%27 HTTP/1.1" 200 None
2026-03-28 07:36:01 [auto1.de] INFO: Scrape type for RZ53370: 0
2026-03-28 07:36:01 [auto1.de] INFO: Found listing with ID: NB45839
2026-03-28 07:36:01 [auto1.de] INFO: Found listing with ID: WP48993
2026-03-28 07:36:01 [auto1.de] INFO: Found listing with ID: VT29365
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT29365%27 HTTP/1.1" 200 None
2026-03-28 07:36:01 [auto1.de] INFO: Scrape type for VT29365: 0
2026-03-28 07:36:01 [auto1.de] INFO: Found listing with ID: LR25618
2026-03-28 07:36:01 [auto1.de] INFO: Found listing with ID: VZ74394
2026-03-28 07:36:01 [auto1.de] INFO: Found listing with ID: EW54456
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW54456%27 HTTP/1.1" 200 None
2026-03-28 07:36:01 [auto1.de] INFO: Scrape type for EW54456: 2
2026-03-28 07:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6160e90-c6a5-5203-af51-5018a4498b33 with identifier: EW54456
2026-03-28 07:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6160e90-c6a5-5203-af51-5018a4498b33 with scrape type 2
2026-03-28 07:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6160e90-c6a5-5203-af51-5018a4498b33 with scrape type 2
2026-03-28 07:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6160e90-c6a5-5203-af51-5018a4498b33, identifier: EW54456
2026-03-28 07:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6160e90-c6a5-5203-af51-5018a4498b33 with identifier: EW54456
2026-03-28 07:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6160e90-c6a5-5203-af51-5018a4498b33 with identifier: EW54456
2026-03-28 07:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6160e90-c6a5-5203-af51-5018a4498b33 with identifier: EW54456 to the API
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 220,
'expiration_date': '2026-03-28T16:31:42Z',
'fuel_type': 'diesel',
'id': 'a6160e90-c6a5-5203-af51-5018a4498b33',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW54456',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 66825,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-24',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid T 4Matic Avantgarde',
'transmission': 'automatic',
'trim': 'T 4Matic Avantgarde',
'year': 2023}
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW54456%27 HTTP/1.1" 200 None
2026-03-28 07:36:01 [auto1.de] INFO: Saving data for EW54456: {'auction_closing_time': 1774715502.0, 'created_time': 1773341498.245972, 'last_price_update_time': 1774683361.624164}
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW54456') HTTP/1.1" 204 0
2026-03-28 07:36:01 [auto1.de] INFO: Found listing with ID: UD63369
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD63369%27 HTTP/1.1" 200 None
2026-03-28 07:36:01 [auto1.de] INFO: Scrape type for UD63369: 0
2026-03-28 07:36:01 [auto1.de] INFO: Found listing with ID: NE03799
2026-03-28 07:36:01 [auto1.de] INFO: Found listing with ID: VX61126
2026-03-28 07:36:01 [auto1.de] INFO: Found listing with ID: LA58021
2026-03-28 07:36:01 [auto1.de] INFO: Found listing with ID: YM60509
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM60509%27 HTTP/1.1" 200 None
2026-03-28 07:36:01 [auto1.de] INFO: Scrape type for YM60509: 0
2026-03-28 07:36:01 [auto1.de] INFO: Found listing with ID: WA68072
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68072%27 HTTP/1.1" 200 None
2026-03-28 07:36:01 [auto1.de] INFO: Scrape type for WA68072: 0
2026-03-28 07:36:01 [auto1.de] INFO: Found listing with ID: MP73357
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP73357%27 HTTP/1.1" 200 None
2026-03-28 07:36:01 [auto1.de] INFO: Scrape type for MP73357: 2
2026-03-28 07:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0caa132-2f9e-5946-ba29-831ffa4de1f0 with identifier: MP73357
2026-03-28 07:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0caa132-2f9e-5946-ba29-831ffa4de1f0 with scrape type 2
2026-03-28 07:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0caa132-2f9e-5946-ba29-831ffa4de1f0 with scrape type 2
2026-03-28 07:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0caa132-2f9e-5946-ba29-831ffa4de1f0, identifier: MP73357
2026-03-28 07:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0caa132-2f9e-5946-ba29-831ffa4de1f0 with identifier: MP73357
2026-03-28 07:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0caa132-2f9e-5946-ba29-831ffa4de1f0 with identifier: MP73357
2026-03-28 07:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0caa132-2f9e-5946-ba29-831ffa4de1f0 with identifier: MP73357 to the API
2026-03-28 07:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:10:57Z',
'fuel_type': 'petrol',
'id': 'f0caa132-2f9e-5946-ba29-831ffa4de1f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP73357',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 90557,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-24',
'seller_name': None,
'title': 'Hyundai i30 1.4 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2014}
2026-03-28 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP73357%27 HTTP/1.1" 200 None
2026-03-28 07:36:02 [auto1.de] INFO: Saving data for MP73357: {'auction_closing_time': 1774714257.0, 'created_time': 1773829854.903085, 'last_price_update_time': 1774683362.223298}
2026-03-28 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP73357') HTTP/1.1" 204 0
2026-03-28 07:36:02 [auto1.de] INFO: Found listing with ID: AH41759
2026-03-28 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH41759%27 HTTP/1.1" 200 None
2026-03-28 07:36:02 [auto1.de] INFO: Scrape type for AH41759: 2
2026-03-28 07:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85059cfd-e507-5410-b702-ecaca6d92e40 with identifier: AH41759
2026-03-28 07:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85059cfd-e507-5410-b702-ecaca6d92e40 with scrape type 2
2026-03-28 07:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85059cfd-e507-5410-b702-ecaca6d92e40 with scrape type 2
2026-03-28 07:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85059cfd-e507-5410-b702-ecaca6d92e40, identifier: AH41759
2026-03-28 07:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85059cfd-e507-5410-b702-ecaca6d92e40 with identifier: AH41759
2026-03-28 07:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85059cfd-e507-5410-b702-ecaca6d92e40 with identifier: AH41759
2026-03-28 07:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85059cfd-e507-5410-b702-ecaca6d92e40 with identifier: AH41759 to the API
2026-03-28 07:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-28T16:03:04Z',
'fuel_type': 'diesel',
'id': '85059cfd-e507-5410-b702-ecaca6d92e40',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH41759',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 172654,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-10',
'seller_name': None,
'title': 'Audi A4 3.0 V6 TDI clean diesel quattro S line Sportpaket plus',
'transmission': 'automatic',
'trim': 'quattro S line Sportpaket plus',
'year': 2014}
2026-03-28 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH41759%27 HTTP/1.1" 200 None
2026-03-28 07:36:03 [auto1.de] INFO: Saving data for AH41759: {'auction_closing_time': 1774713784.0, 'created_time': 1774466427.944431, 'last_price_update_time': 1774683363.67231}
2026-03-28 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH41759') HTTP/1.1" 204 0
2026-03-28 07:36:03 [auto1.de] INFO: Found listing with ID: FW28639
2026-03-28 07:36:03 [auto1.de] INFO: Found listing with ID: KD39094
2026-03-28 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD39094%27 HTTP/1.1" 200 None
2026-03-28 07:36:03 [auto1.de] INFO: Scrape type for KD39094: 0
2026-03-28 07:36:03 [auto1.de] INFO: Found listing with ID: PL18680
2026-03-28 07:36:03 [auto1.de] INFO: Found listing with ID: GB96559
2026-03-28 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB96559%27 HTTP/1.1" 200 None
2026-03-28 07:36:03 [auto1.de] INFO: Scrape type for GB96559: 0
2026-03-28 07:36:03 [auto1.de] INFO: Found listing with ID: WG34535
2026-03-28 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG34535%27 HTTP/1.1" 200 None
2026-03-28 07:36:03 [auto1.de] INFO: Scrape type for WG34535: 0
2026-03-28 07:36:03 [auto1.de] INFO: Found listing with ID: FS91363
2026-03-28 07:36:03 [auto1.de] INFO: Found listing with ID: VJ37696
2026-03-28 07:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:36:03 [auto1.de] INFO: Channel: 24h | Page: 66 | totalHits: 9255 | hits on page: 40
2026-03-28 07:36:03 [auto1.de] INFO: Found listing with ID: KB53133
2026-03-28 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB53133%27 HTTP/1.1" 200 None
2026-03-28 07:36:03 [auto1.de] INFO: Scrape type for KB53133: 2
2026-03-28 07:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c0a4252-a7c9-5d30-bfe5-74574a9ce965 with identifier: KB53133
2026-03-28 07:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c0a4252-a7c9-5d30-bfe5-74574a9ce965 with scrape type 2
2026-03-28 07:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c0a4252-a7c9-5d30-bfe5-74574a9ce965 with scrape type 2
2026-03-28 07:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c0a4252-a7c9-5d30-bfe5-74574a9ce965, identifier: KB53133
2026-03-28 07:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c0a4252-a7c9-5d30-bfe5-74574a9ce965 with identifier: KB53133
2026-03-28 07:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c0a4252-a7c9-5d30-bfe5-74574a9ce965 with identifier: KB53133
2026-03-28 07:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c0a4252-a7c9-5d30-bfe5-74574a9ce965 with identifier: KB53133 to the API
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 173,
'expiration_date': '2026-03-28T16:18:53Z',
'fuel_type': 'diesel',
'id': '7c0a4252-a7c9-5d30-bfe5-74574a9ce965',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB53133',
'listing': 'auction',
'make': 'Toyota',
'model': 'Land Cruiser',
'odometer': 237174,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-11-25',
'seller_name': None,
'title': 'Toyota Land Cruiser 3.0 D-4D Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2007}
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB53133%27 HTTP/1.1" 200 None
2026-03-28 07:36:04 [auto1.de] INFO: Saving data for KB53133: {'auction_closing_time': 1774714733.0, 'created_time': 1773860893.766503, 'last_price_update_time': 1774683364.398002}
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB53133') HTTP/1.1" 204 0
2026-03-28 07:36:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: JJ90967
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: MR37276
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: HP53076
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP53076%27 HTTP/1.1" 200 None
2026-03-28 07:36:04 [auto1.de] INFO: Scrape type for HP53076: 0
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: ZX35425
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: PJ24227
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ24227%27 HTTP/1.1" 200 None
2026-03-28 07:36:04 [auto1.de] INFO: Scrape type for PJ24227: 0
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: PX70527
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: JL65516
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL65516%27 HTTP/1.1" 200 None
2026-03-28 07:36:04 [auto1.de] INFO: Scrape type for JL65516: 0
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: SS68419
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS68419%27 HTTP/1.1" 200 None
2026-03-28 07:36:04 [auto1.de] INFO: Scrape type for SS68419: 0
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: DH25431
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH25431%27 HTTP/1.1" 200 None
2026-03-28 07:36:04 [auto1.de] INFO: Scrape type for DH25431: 0
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: XC99684
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: SN64642
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN64642%27 HTTP/1.1" 200 None
2026-03-28 07:36:04 [auto1.de] INFO: Scrape type for SN64642: 0
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: VH61695
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: NT23375
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: AV48521
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: RC84625
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC84625%27 HTTP/1.1" 200 None
2026-03-28 07:36:04 [auto1.de] INFO: Scrape type for RC84625: 0
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: ZH41953
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: CP53308
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP53308%27 HTTP/1.1" 200 None
2026-03-28 07:36:04 [auto1.de] INFO: Scrape type for CP53308: 0
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: KF64937
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF64937%27 HTTP/1.1" 200 None
2026-03-28 07:36:04 [auto1.de] INFO: Scrape type for KF64937: 0
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: RP45583
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: VC17090
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: FE71372
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: KV09163
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV09163%27 HTTP/1.1" 200 None
2026-03-28 07:36:04 [auto1.de] INFO: Scrape type for KV09163: 0
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: VG95526
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: MP89368
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: EC98631
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC98631%27 HTTP/1.1" 200 None
2026-03-28 07:36:04 [auto1.de] INFO: Scrape type for EC98631: 0
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: GG51597
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: FN83221
2026-03-28 07:36:04 [auto1.de] INFO: Found listing with ID: FV69098
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV69098%27 HTTP/1.1" 200 None
2026-03-28 07:36:04 [auto1.de] INFO: Scrape type for FV69098: 2
2026-03-28 07:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5243898-cf6f-526f-a44c-c1266f8030a1 with identifier: FV69098
2026-03-28 07:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5243898-cf6f-526f-a44c-c1266f8030a1 with scrape type 2
2026-03-28 07:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5243898-cf6f-526f-a44c-c1266f8030a1 with scrape type 2
2026-03-28 07:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5243898-cf6f-526f-a44c-c1266f8030a1, identifier: FV69098
2026-03-28 07:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5243898-cf6f-526f-a44c-c1266f8030a1 with identifier: FV69098
2026-03-28 07:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5243898-cf6f-526f-a44c-c1266f8030a1 with identifier: FV69098
2026-03-28 07:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5243898-cf6f-526f-a44c-c1266f8030a1 with identifier: FV69098 to the API
2026-03-28 07:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 69,
'expiration_date': '2026-03-28T16:11:49Z',
'fuel_type': 'petrol',
'id': 'd5243898-cf6f-526f-a44c-c1266f8030a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV69098',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 21574,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-30',
'seller_name': None,
'title': 'Fiat 500 1.0 Mild-Hybrid Dolcevita',
'transmission': 'manual',
'trim': 'Dolcevita',
'year': 2023}
2026-03-28 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV69098%27 HTTP/1.1" 200 None
2026-03-28 07:36:05 [auto1.de] INFO: Saving data for FV69098: {'auction_closing_time': 1774714309.0, 'created_time': 1774465961.311586, 'last_price_update_time': 1774683365.187378}
2026-03-28 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV69098') HTTP/1.1" 204 0
2026-03-28 07:36:05 [auto1.de] INFO: Found listing with ID: UU35907
2026-03-28 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU35907%27 HTTP/1.1" 200 None
2026-03-28 07:36:05 [auto1.de] INFO: Scrape type for UU35907: 0
2026-03-28 07:36:05 [auto1.de] INFO: Found listing with ID: DX01657
2026-03-28 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX01657%27 HTTP/1.1" 200 None
2026-03-28 07:36:05 [auto1.de] INFO: Scrape type for DX01657: 0
2026-03-28 07:36:05 [auto1.de] INFO: Found listing with ID: CL15351
2026-03-28 07:36:05 [auto1.de] INFO: Found listing with ID: FD13282
2026-03-28 07:36:05 [auto1.de] INFO: Found listing with ID: XM82116
2026-03-28 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM82116%27 HTTP/1.1" 200 None
2026-03-28 07:36:05 [auto1.de] INFO: Scrape type for XM82116: 0
2026-03-28 07:36:05 [auto1.de] INFO: Found listing with ID: KX24751
2026-03-28 07:36:05 [auto1.de] INFO: Found listing with ID: HS47507
2026-03-28 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS47507%27 HTTP/1.1" 200 None
2026-03-28 07:36:05 [auto1.de] INFO: Scrape type for HS47507: 2
2026-03-28 07:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b17e6fd9-824e-5566-a407-8d8227b62218 with identifier: HS47507
2026-03-28 07:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b17e6fd9-824e-5566-a407-8d8227b62218 with scrape type 2
2026-03-28 07:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b17e6fd9-824e-5566-a407-8d8227b62218 with scrape type 2
2026-03-28 07:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b17e6fd9-824e-5566-a407-8d8227b62218, identifier: HS47507
2026-03-28 07:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b17e6fd9-824e-5566-a407-8d8227b62218 with identifier: HS47507
2026-03-28 07:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b17e6fd9-824e-5566-a407-8d8227b62218 with identifier: HS47507
2026-03-28 07:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b17e6fd9-824e-5566-a407-8d8227b62218 with identifier: HS47507 to the API
2026-03-28 07:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-28T16:00:00Z',
'fuel_type': 'diesel',
'id': 'b17e6fd9-824e-5566-a407-8d8227b62218',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS47507',
'listing': 'auction',
'make': 'Kia',
'model': 'Sorento',
'odometer': 158369,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-16',
'seller_name': None,
'title': 'Kia Sorento 2.2 CRDi GT-Line 4WD',
'transmission': 'automatic',
'trim': 'GT-Line 4WD',
'year': 2018}
2026-03-28 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS47507%27 HTTP/1.1" 200 None
2026-03-28 07:36:06 [auto1.de] INFO: Saving data for HS47507: {'auction_closing_time': 1774713600.0, 'created_time': 1774034529.306279, 'last_price_update_time': 1774683366.174375}
2026-03-28 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS47507') HTTP/1.1" 204 0
2026-03-28 07:36:06 [auto1.de] INFO: Found listing with ID: UY83334
2026-03-28 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY83334%27 HTTP/1.1" 200 None
2026-03-28 07:36:06 [auto1.de] INFO: Scrape type for UY83334: 2
2026-03-28 07:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3183ad36-a216-52cd-bdbc-79abc5d89edb with identifier: UY83334
2026-03-28 07:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3183ad36-a216-52cd-bdbc-79abc5d89edb with scrape type 2
2026-03-28 07:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3183ad36-a216-52cd-bdbc-79abc5d89edb with scrape type 2
2026-03-28 07:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3183ad36-a216-52cd-bdbc-79abc5d89edb, identifier: UY83334
2026-03-28 07:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3183ad36-a216-52cd-bdbc-79abc5d89edb with identifier: UY83334
2026-03-28 07:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3183ad36-a216-52cd-bdbc-79abc5d89edb with identifier: UY83334
2026-03-28 07:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3183ad36-a216-52cd-bdbc-79abc5d89edb with identifier: UY83334 to the API
2026-03-28 07:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 511,
'expiration_date': '2026-03-28T16:45:18Z',
'fuel_type': 'petrol',
'id': '3183ad36-a216-52cd-bdbc-79abc5d89edb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY83334',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 74633,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-06',
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 580 Mild-Hybrid 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2020}
2026-03-28 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY83334%27 HTTP/1.1" 200 None
2026-03-28 07:36:06 [auto1.de] INFO: Saving data for UY83334: {'auction_closing_time': 1774716318.0, 'created_time': 1774466073.533093, 'last_price_update_time': 1774683366.602983}
2026-03-28 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY83334') HTTP/1.1" 204 0
2026-03-28 07:36:06 [auto1.de] INFO: Found listing with ID: TP43988
2026-03-28 07:36:06 [auto1.de] INFO: Found listing with ID: RJ76690
2026-03-28 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ76690%27 HTTP/1.1" 200 None
2026-03-28 07:36:06 [auto1.de] INFO: Scrape type for RJ76690: 0
2026-03-28 07:36:06 [auto1.de] INFO: Found listing with ID: BP72129
2026-03-28 07:36:06 [scrapy.extensions.logstats] INFO: Crawled 72 pages (at 15 pages/min), scraped 279 items (at 60 items/min)
2026-03-28 07:36:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 165MiB
2026-03-28 07:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:36:07 [auto1.de] INFO: Channel: 24h | Page: 67 | totalHits: 9255 | hits on page: 40
2026-03-28 07:36:07 [auto1.de] INFO: Found listing with ID: VC02899
2026-03-28 07:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC02899%27 HTTP/1.1" 200 None
2026-03-28 07:36:07 [auto1.de] INFO: Scrape type for VC02899: 0
2026-03-28 07:36:07 [auto1.de] INFO: Found listing with ID: FM53272
2026-03-28 07:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM53272%27 HTTP/1.1" 200 None
2026-03-28 07:36:07 [auto1.de] INFO: Scrape type for FM53272: 0
2026-03-28 07:36:07 [auto1.de] INFO: Found listing with ID: CP21456
2026-03-28 07:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP21456%27 HTTP/1.1" 200 None
2026-03-28 07:36:07 [auto1.de] INFO: Scrape type for CP21456: 2
2026-03-28 07:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6472f64e-00a6-5a99-b67c-75bb4da62ac6 with identifier: CP21456
2026-03-28 07:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6472f64e-00a6-5a99-b67c-75bb4da62ac6 with scrape type 2
2026-03-28 07:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6472f64e-00a6-5a99-b67c-75bb4da62ac6 with scrape type 2
2026-03-28 07:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6472f64e-00a6-5a99-b67c-75bb4da62ac6, identifier: CP21456
2026-03-28 07:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6472f64e-00a6-5a99-b67c-75bb4da62ac6 with identifier: CP21456
2026-03-28 07:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6472f64e-00a6-5a99-b67c-75bb4da62ac6 with identifier: CP21456
2026-03-28 07:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6472f64e-00a6-5a99-b67c-75bb4da62ac6 with identifier: CP21456 to the API
2026-03-28 07:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:51:35Z',
'fuel_type': 'diesel',
'id': '6472f64e-00a6-5a99-b67c-75bb4da62ac6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP21456',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 142826,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-17',
'seller_name': None,
'title': 'Opel Astra 1.6 CDTI 120 Jahre Start/Stop',
'transmission': 'automatic',
'trim': '120 Jahre Start/Stop',
'year': 2019}
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP21456%27 HTTP/1.1" 200 None
2026-03-28 07:36:08 [auto1.de] INFO: Saving data for CP21456: {'auction_closing_time': 1774716695.0, 'created_time': 1774503046.909741, 'last_price_update_time': 1774683368.076929}
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP21456') HTTP/1.1" 204 0
2026-03-28 07:36:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:36:08 [auto1.de] INFO: Found listing with ID: RB81388
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB81388%27 HTTP/1.1" 200 None
2026-03-28 07:36:08 [auto1.de] INFO: Scrape type for RB81388: 0
2026-03-28 07:36:08 [auto1.de] INFO: Found listing with ID: TJ40374
2026-03-28 07:36:08 [auto1.de] INFO: Found listing with ID: GL23432
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL23432%27 HTTP/1.1" 200 None
2026-03-28 07:36:08 [auto1.de] INFO: Scrape type for GL23432: 0
2026-03-28 07:36:08 [auto1.de] INFO: Found listing with ID: BJ59034
2026-03-28 07:36:08 [auto1.de] INFO: Found listing with ID: KZ61437
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ61437%27 HTTP/1.1" 200 None
2026-03-28 07:36:08 [auto1.de] INFO: Scrape type for KZ61437: 0
2026-03-28 07:36:08 [auto1.de] INFO: Found listing with ID: YC00540
2026-03-28 07:36:08 [auto1.de] INFO: Found listing with ID: UD91634
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD91634%27 HTTP/1.1" 200 None
2026-03-28 07:36:08 [auto1.de] INFO: Scrape type for UD91634: 0
2026-03-28 07:36:08 [auto1.de] INFO: Found listing with ID: XT50939
2026-03-28 07:36:08 [auto1.de] INFO: Found listing with ID: DF24349
2026-03-28 07:36:08 [auto1.de] INFO: Found listing with ID: XC05261
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC05261%27 HTTP/1.1" 200 None
2026-03-28 07:36:08 [auto1.de] INFO: Scrape type for XC05261: 0
2026-03-28 07:36:08 [auto1.de] INFO: Found listing with ID: RG64089
2026-03-28 07:36:08 [auto1.de] INFO: Found listing with ID: AF02191
2026-03-28 07:36:08 [auto1.de] INFO: Found listing with ID: CN06101
2026-03-28 07:36:08 [auto1.de] INFO: Found listing with ID: ZD23730
2026-03-28 07:36:08 [auto1.de] INFO: Found listing with ID: LD10656
2026-03-28 07:36:08 [auto1.de] INFO: Found listing with ID: NY16629
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY16629%27 HTTP/1.1" 200 None
2026-03-28 07:36:08 [auto1.de] INFO: Scrape type for NY16629: 0
2026-03-28 07:36:08 [auto1.de] INFO: Found listing with ID: JC12904
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC12904%27 HTTP/1.1" 200 None
2026-03-28 07:36:08 [auto1.de] INFO: Scrape type for JC12904: 2
2026-03-28 07:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6937083-b33b-5919-8c56-e00e1f600fba with identifier: JC12904
2026-03-28 07:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6937083-b33b-5919-8c56-e00e1f600fba with scrape type 2
2026-03-28 07:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6937083-b33b-5919-8c56-e00e1f600fba with scrape type 2
2026-03-28 07:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6937083-b33b-5919-8c56-e00e1f600fba, identifier: JC12904
2026-03-28 07:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6937083-b33b-5919-8c56-e00e1f600fba with identifier: JC12904
2026-03-28 07:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6937083-b33b-5919-8c56-e00e1f600fba with identifier: JC12904
2026-03-28 07:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6937083-b33b-5919-8c56-e00e1f600fba with identifier: JC12904 to the API
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:05:50Z',
'fuel_type': 'petrol',
'id': 'e6937083-b33b-5919-8c56-e00e1f600fba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC12904',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 92864,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-26',
'seller_name': None,
'title': 'Skoda Fabia 1.2 TSI Best of',
'transmission': 'manual',
'trim': 'Best of',
'year': 2014}
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC12904%27 HTTP/1.1" 200 None
2026-03-28 07:36:08 [auto1.de] INFO: Saving data for JC12904: {'auction_closing_time': 1774713950.0, 'created_time': 1774465926.749807, 'last_price_update_time': 1774683368.717816}
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC12904') HTTP/1.1" 204 0
2026-03-28 07:36:08 [auto1.de] INFO: Found listing with ID: SM09271
2026-03-28 07:36:08 [auto1.de] INFO: Found listing with ID: RX38122
2026-03-28 07:36:08 [auto1.de] INFO: Found listing with ID: SX67317
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX67317%27 HTTP/1.1" 200 None
2026-03-28 07:36:08 [auto1.de] INFO: Scrape type for SX67317: 0
2026-03-28 07:36:08 [auto1.de] INFO: Found listing with ID: MS04579
2026-03-28 07:36:08 [auto1.de] INFO: Found listing with ID: XM71416
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM71416%27 HTTP/1.1" 200 None
2026-03-28 07:36:08 [auto1.de] INFO: Scrape type for XM71416: 2
2026-03-28 07:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 496b03c6-64f1-5094-b66b-ca8a05edbd3d with identifier: XM71416
2026-03-28 07:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 496b03c6-64f1-5094-b66b-ca8a05edbd3d with scrape type 2
2026-03-28 07:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 496b03c6-64f1-5094-b66b-ca8a05edbd3d with scrape type 2
2026-03-28 07:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 496b03c6-64f1-5094-b66b-ca8a05edbd3d, identifier: XM71416
2026-03-28 07:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 496b03c6-64f1-5094-b66b-ca8a05edbd3d with identifier: XM71416
2026-03-28 07:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 496b03c6-64f1-5094-b66b-ca8a05edbd3d with identifier: XM71416
2026-03-28 07:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 496b03c6-64f1-5094-b66b-ca8a05edbd3d with identifier: XM71416 to the API
2026-03-28 07:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:48:27Z',
'fuel_type': 'petrol',
'id': '496b03c6-64f1-5094-b66b-ca8a05edbd3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM71416',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 78878,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-25',
'seller_name': None,
'title': 'Renault Clio 1.2 Extreme',
'transmission': 'manual',
'trim': 'Extreme',
'year': 2009}
2026-03-28 07:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM71416%27 HTTP/1.1" 200 None
2026-03-28 07:36:09 [auto1.de] INFO: Saving data for XM71416: {'auction_closing_time': 1774716507.0, 'created_time': 1774466825.364328, 'last_price_update_time': 1774683369.249555}
2026-03-28 07:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM71416') HTTP/1.1" 204 0
2026-03-28 07:36:09 [auto1.de] INFO: Found listing with ID: KR30389
2026-03-28 07:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR30389%27 HTTP/1.1" 200 None
2026-03-28 07:36:09 [auto1.de] INFO: Scrape type for KR30389: 0
2026-03-28 07:36:09 [auto1.de] INFO: Found listing with ID: JX93926
2026-03-28 07:36:09 [auto1.de] INFO: Found listing with ID: MR02811
2026-03-28 07:36:09 [auto1.de] INFO: Found listing with ID: AA40394
2026-03-28 07:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA40394%27 HTTP/1.1" 200 None
2026-03-28 07:36:09 [auto1.de] INFO: Scrape type for AA40394: 0
2026-03-28 07:36:09 [auto1.de] INFO: Found listing with ID: TE18178
2026-03-28 07:36:09 [auto1.de] INFO: Found listing with ID: JL42140
2026-03-28 07:36:09 [auto1.de] INFO: Found listing with ID: KL90594
2026-03-28 07:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL90594%27 HTTP/1.1" 200 None
2026-03-28 07:36:09 [auto1.de] INFO: Scrape type for KL90594: 0
2026-03-28 07:36:09 [auto1.de] INFO: Found listing with ID: ZR85378
2026-03-28 07:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR85378%27 HTTP/1.1" 200 None
2026-03-28 07:36:09 [auto1.de] INFO: Scrape type for ZR85378: 0
2026-03-28 07:36:09 [auto1.de] INFO: Found listing with ID: HY62611
2026-03-28 07:36:09 [auto1.de] INFO: Found listing with ID: JM60205
2026-03-28 07:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM60205%27 HTTP/1.1" 200 None
2026-03-28 07:36:09 [auto1.de] INFO: Scrape type for JM60205: 0
2026-03-28 07:36:09 [auto1.de] INFO: Found listing with ID: XC77974
2026-03-28 07:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC77974%27 HTTP/1.1" 200 None
2026-03-28 07:36:09 [auto1.de] INFO: Scrape type for XC77974: 2
2026-03-28 07:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b054cc42-7d67-5d96-8533-0a4be33b810d with identifier: XC77974
2026-03-28 07:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b054cc42-7d67-5d96-8533-0a4be33b810d with scrape type 2
2026-03-28 07:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b054cc42-7d67-5d96-8533-0a4be33b810d with scrape type 2
2026-03-28 07:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b054cc42-7d67-5d96-8533-0a4be33b810d, identifier: XC77974
2026-03-28 07:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b054cc42-7d67-5d96-8533-0a4be33b810d with identifier: XC77974
2026-03-28 07:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b054cc42-7d67-5d96-8533-0a4be33b810d with identifier: XC77974
2026-03-28 07:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b054cc42-7d67-5d96-8533-0a4be33b810d with identifier: XC77974 to the API
2026-03-28 07:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 141,
'expiration_date': '2026-03-28T16:01:09Z',
'fuel_type': 'hybrid',
'id': 'b054cc42-7d67-5d96-8533-0a4be33b810d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC77974',
'listing': 'auction',
'make': 'Kia',
'model': 'Niro',
'odometer': 19077,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-31',
'seller_name': None,
'title': 'Kia Niro 1.6 Plug-in Hybrid Spirit',
'transmission': 'automatic',
'trim': 'Spirit',
'year': 2021}
2026-03-28 07:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC77974%27 HTTP/1.1" 200 None
2026-03-28 07:36:09 [auto1.de] INFO: Saving data for XC77974: {'auction_closing_time': 1774713669.0, 'created_time': 1774466574.946247, 'last_price_update_time': 1774683369.78424}
2026-03-28 07:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC77974') HTTP/1.1" 204 0
2026-03-28 07:36:09 [auto1.de] INFO: Found listing with ID: MF87973
2026-03-28 07:36:09 [auto1.de] INFO: Found listing with ID: BB37977
2026-03-28 07:36:09 [auto1.de] INFO: Found listing with ID: DZ63876
2026-03-28 07:36:09 [auto1.de] INFO: Found listing with ID: AE27507
2026-03-28 07:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:36:10 [auto1.de] INFO: Channel: 24h | Page: 68 | totalHits: 9255 | hits on page: 40
2026-03-28 07:36:10 [auto1.de] INFO: Found listing with ID: KT42001
2026-03-28 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT42001%27 HTTP/1.1" 200 None
2026-03-28 07:36:10 [auto1.de] INFO: Scrape type for KT42001: 2
2026-03-28 07:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 840b13d2-d557-50be-906c-2718f0beb8ac with identifier: KT42001
2026-03-28 07:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 840b13d2-d557-50be-906c-2718f0beb8ac with scrape type 2
2026-03-28 07:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 840b13d2-d557-50be-906c-2718f0beb8ac with scrape type 2
2026-03-28 07:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 840b13d2-d557-50be-906c-2718f0beb8ac, identifier: KT42001
2026-03-28 07:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 840b13d2-d557-50be-906c-2718f0beb8ac with identifier: KT42001
2026-03-28 07:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 840b13d2-d557-50be-906c-2718f0beb8ac with identifier: KT42001
2026-03-28 07:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 840b13d2-d557-50be-906c-2718f0beb8ac with identifier: KT42001 to the API
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:52:35Z',
'fuel_type': 'petrol',
'id': '840b13d2-d557-50be-906c-2718f0beb8ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT42001',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 111303,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-16',
'seller_name': None,
'title': 'Skoda Fabia 1.2 TSI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2015}
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT42001%27 HTTP/1.1" 200 None
2026-03-28 07:36:11 [auto1.de] INFO: Saving data for KT42001: {'auction_closing_time': 1774716755.0, 'created_time': 1774468089.640874, 'last_price_update_time': 1774683371.681609}
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT42001') HTTP/1.1" 204 0
2026-03-28 07:36:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: RX73377
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: RW07911
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: VJ08081
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ08081%27 HTTP/1.1" 200 None
2026-03-28 07:36:11 [auto1.de] INFO: Scrape type for VJ08081: 0
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: SM08182
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM08182%27 HTTP/1.1" 200 None
2026-03-28 07:36:11 [auto1.de] INFO: Scrape type for SM08182: 0
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: PJ27093
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ27093%27 HTTP/1.1" 200 None
2026-03-28 07:36:11 [auto1.de] INFO: Scrape type for PJ27093: 0
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: FM78984
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: WU50689
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU50689%27 HTTP/1.1" 200 None
2026-03-28 07:36:11 [auto1.de] INFO: Scrape type for WU50689: 0
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: PA19754
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA19754%27 HTTP/1.1" 200 None
2026-03-28 07:36:11 [auto1.de] INFO: Scrape type for PA19754: 0
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: SV18867
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV18867%27 HTTP/1.1" 200 None
2026-03-28 07:36:11 [auto1.de] INFO: Scrape type for SV18867: 0
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: AF68122
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF68122%27 HTTP/1.1" 200 None
2026-03-28 07:36:11 [auto1.de] INFO: Scrape type for AF68122: 0
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: SG95649
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG95649%27 HTTP/1.1" 200 None
2026-03-28 07:36:11 [auto1.de] INFO: Scrape type for SG95649: 0
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: UB61823
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: CN74001
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: DG73044
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG73044%27 HTTP/1.1" 200 None
2026-03-28 07:36:11 [auto1.de] INFO: Scrape type for DG73044: 0
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: UW10679
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW10679%27 HTTP/1.1" 200 None
2026-03-28 07:36:11 [auto1.de] INFO: Scrape type for UW10679: 0
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: SC80606
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC80606%27 HTTP/1.1" 200 None
2026-03-28 07:36:11 [auto1.de] INFO: Scrape type for SC80606: 0
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: CC80699
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: XV15906
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV15906%27 HTTP/1.1" 200 None
2026-03-28 07:36:11 [auto1.de] INFO: Scrape type for XV15906: 0
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: ZF80187
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF80187%27 HTTP/1.1" 200 None
2026-03-28 07:36:11 [auto1.de] INFO: Scrape type for ZF80187: 0
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: NT47170
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT47170%27 HTTP/1.1" 200 None
2026-03-28 07:36:11 [auto1.de] INFO: Scrape type for NT47170: 0
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: PP91076
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: ZT12374
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT12374%27 HTTP/1.1" 200 None
2026-03-28 07:36:11 [auto1.de] INFO: Scrape type for ZT12374: 0
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: HM75653
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: CS71066
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: SW04854
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: RH18539
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: PD05251
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD05251%27 HTTP/1.1" 200 None
2026-03-28 07:36:11 [auto1.de] INFO: Scrape type for PD05251: 0
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: DC87160
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: WZ38880
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: XK64077
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK64077%27 HTTP/1.1" 200 None
2026-03-28 07:36:11 [auto1.de] INFO: Scrape type for XK64077: 0
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: HD39951
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD39951%27 HTTP/1.1" 200 None
2026-03-28 07:36:11 [auto1.de] INFO: Scrape type for HD39951: 0
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: WD55827
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: EX30912
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: MP81414
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: TN32839
2026-03-28 07:36:11 [auto1.de] INFO: Found listing with ID: TE76354
2026-03-28 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE76354%27 HTTP/1.1" 200 None
2026-03-28 07:36:12 [auto1.de] INFO: Scrape type for TE76354: 2
2026-03-28 07:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce328c74-abdd-5423-9bd2-368d4a7d5a78 with identifier: TE76354
2026-03-28 07:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce328c74-abdd-5423-9bd2-368d4a7d5a78 with scrape type 2
2026-03-28 07:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce328c74-abdd-5423-9bd2-368d4a7d5a78 with scrape type 2
2026-03-28 07:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce328c74-abdd-5423-9bd2-368d4a7d5a78, identifier: TE76354
2026-03-28 07:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce328c74-abdd-5423-9bd2-368d4a7d5a78 with identifier: TE76354
2026-03-28 07:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce328c74-abdd-5423-9bd2-368d4a7d5a78 with identifier: TE76354
2026-03-28 07:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce328c74-abdd-5423-9bd2-368d4a7d5a78 with identifier: TE76354 to the API
2026-03-28 07:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-28T16:49:28Z',
'fuel_type': 'petrol',
'id': 'ce328c74-abdd-5423-9bd2-368d4a7d5a78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE76354',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 50780,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-06-11',
'seller_name': None,
'title': 'Audi A3 Sportback 1.8 TFSI Ambiente',
'transmission': 'automatic',
'trim': 'Ambiente',
'year': 2008}
2026-03-28 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE76354%27 HTTP/1.1" 200 None
2026-03-28 07:36:12 [auto1.de] INFO: Saving data for TE76354: {'auction_closing_time': 1774716568.0, 'created_time': 1774466416.287966, 'last_price_update_time': 1774683372.443329}
2026-03-28 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE76354') HTTP/1.1" 204 0
2026-03-28 07:36:12 [auto1.de] INFO: Found listing with ID: SB33889
2026-03-28 07:36:12 [auto1.de] INFO: Found listing with ID: TC03935
2026-03-28 07:36:12 [auto1.de] INFO: Found listing with ID: EM65900
2026-03-28 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM65900%27 HTTP/1.1" 200 None
2026-03-28 07:36:12 [auto1.de] INFO: Scrape type for EM65900: 0
2026-03-28 07:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:36:13 [auto1.de] INFO: Channel: 24h | Page: 69 | totalHits: 9255 | hits on page: 40
2026-03-28 07:36:13 [auto1.de] INFO: Found listing with ID: MG42268
2026-03-28 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG42268%27 HTTP/1.1" 200 None
2026-03-28 07:36:13 [auto1.de] INFO: Scrape type for MG42268: 0
2026-03-28 07:36:13 [auto1.de] INFO: Found listing with ID: MP16607
2026-03-28 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP16607%27 HTTP/1.1" 200 None
2026-03-28 07:36:13 [auto1.de] INFO: Scrape type for MP16607: 2
2026-03-28 07:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cccc6b78-b549-5c62-aee0-98105acd0f62 with identifier: MP16607
2026-03-28 07:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cccc6b78-b549-5c62-aee0-98105acd0f62 with scrape type 2
2026-03-28 07:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cccc6b78-b549-5c62-aee0-98105acd0f62 with scrape type 2
2026-03-28 07:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cccc6b78-b549-5c62-aee0-98105acd0f62, identifier: MP16607
2026-03-28 07:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cccc6b78-b549-5c62-aee0-98105acd0f62 with identifier: MP16607
2026-03-28 07:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cccc6b78-b549-5c62-aee0-98105acd0f62 with identifier: MP16607
2026-03-28 07:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cccc6b78-b549-5c62-aee0-98105acd0f62 with identifier: MP16607 to the API
2026-03-28 07:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:57:50Z',
'fuel_type': 'diesel',
'id': 'cccc6b78-b549-5c62-aee0-98105acd0f62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP16607',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Citan',
'odometer': 106756,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-02',
'seller_name': None,
'title': 'Mercedes-Benz Citan 108 CDI Lang',
'transmission': 'manual',
'trim': 'Lang',
'year': 2018}
2026-03-28 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP16607%27 HTTP/1.1" 200 None
2026-03-28 07:36:14 [auto1.de] INFO: Saving data for MP16607: {'auction_closing_time': 1774717070.0, 'created_time': 1774468086.714857, 'last_price_update_time': 1774683374.04924}
2026-03-28 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP16607') HTTP/1.1" 204 0
2026-03-28 07:36:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:36:14 [auto1.de] INFO: Found listing with ID: JY89366
2026-03-28 07:36:14 [auto1.de] INFO: Found listing with ID: BU00695
2026-03-28 07:36:14 [auto1.de] INFO: Found listing with ID: NA04350
2026-03-28 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA04350%27 HTTP/1.1" 200 None
2026-03-28 07:36:14 [auto1.de] INFO: Scrape type for NA04350: 2
2026-03-28 07:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bff2dbda-9440-5ae7-9e74-d38fd6cd77e9 with identifier: NA04350
2026-03-28 07:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bff2dbda-9440-5ae7-9e74-d38fd6cd77e9 with scrape type 2
2026-03-28 07:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bff2dbda-9440-5ae7-9e74-d38fd6cd77e9 with scrape type 2
2026-03-28 07:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bff2dbda-9440-5ae7-9e74-d38fd6cd77e9, identifier: NA04350
2026-03-28 07:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bff2dbda-9440-5ae7-9e74-d38fd6cd77e9 with identifier: NA04350
2026-03-28 07:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bff2dbda-9440-5ae7-9e74-d38fd6cd77e9 with identifier: NA04350
2026-03-28 07:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bff2dbda-9440-5ae7-9e74-d38fd6cd77e9 with identifier: NA04350 to the API
2026-03-28 07:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:34:57Z',
'fuel_type': 'petrol',
'id': 'bff2dbda-9440-5ae7-9e74-d38fd6cd77e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA04350',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 143437,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-11-19',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 CrossPolo',
'transmission': 'manual',
'trim': 'Cross',
'year': 2008}
2026-03-28 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA04350%27 HTTP/1.1" 200 None
2026-03-28 07:36:14 [auto1.de] INFO: Saving data for NA04350: {'auction_closing_time': 1774715697.0, 'created_time': 1774464467.129083, 'last_price_update_time': 1774683374.515823}
2026-03-28 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA04350') HTTP/1.1" 204 0
2026-03-28 07:36:14 [auto1.de] INFO: Found listing with ID: PD62787
2026-03-28 07:36:14 [auto1.de] INFO: Found listing with ID: WP40343
2026-03-28 07:36:14 [auto1.de] INFO: Found listing with ID: LH79634
2026-03-28 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH79634%27 HTTP/1.1" 200 None
2026-03-28 07:36:14 [auto1.de] INFO: Scrape type for LH79634: 2
2026-03-28 07:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6318ec8-0254-5d5e-aa75-9bd0f382e151 with identifier: LH79634
2026-03-28 07:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6318ec8-0254-5d5e-aa75-9bd0f382e151 with scrape type 2
2026-03-28 07:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6318ec8-0254-5d5e-aa75-9bd0f382e151 with scrape type 2
2026-03-28 07:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6318ec8-0254-5d5e-aa75-9bd0f382e151, identifier: LH79634
2026-03-28 07:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6318ec8-0254-5d5e-aa75-9bd0f382e151 with identifier: LH79634
2026-03-28 07:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6318ec8-0254-5d5e-aa75-9bd0f382e151 with identifier: LH79634
2026-03-28 07:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6318ec8-0254-5d5e-aa75-9bd0f382e151 with identifier: LH79634 to the API
2026-03-28 07:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-28T16:33:02Z',
'fuel_type': 'petrol',
'id': 'd6318ec8-0254-5d5e-aa75-9bd0f382e151',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH79634',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 24133,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-30',
'seller_name': None,
'title': 'Opel Corsa 1.2 Turbo Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2023}
2026-03-28 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH79634%27 HTTP/1.1" 200 None
2026-03-28 07:36:14 [auto1.de] INFO: Saving data for LH79634: {'auction_closing_time': 1774715582.0, 'created_time': 1774467380.081243, 'last_price_update_time': 1774683374.985361}
2026-03-28 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LH79634') HTTP/1.1" 204 0
2026-03-28 07:36:15 [auto1.de] INFO: Found listing with ID: FM58881
2026-03-28 07:36:15 [auto1.de] INFO: Found listing with ID: BW05751
2026-03-28 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW05751%27 HTTP/1.1" 200 None
2026-03-28 07:36:15 [auto1.de] INFO: Scrape type for BW05751: 0
2026-03-28 07:36:15 [auto1.de] INFO: Found listing with ID: HA73784
2026-03-28 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA73784%27 HTTP/1.1" 200 None
2026-03-28 07:36:15 [auto1.de] INFO: Scrape type for HA73784: 0
2026-03-28 07:36:15 [auto1.de] INFO: Found listing with ID: DZ69774
2026-03-28 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ69774%27 HTTP/1.1" 200 None
2026-03-28 07:36:15 [auto1.de] INFO: Scrape type for DZ69774: 2
2026-03-28 07:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d8d80f2-5540-5440-9e64-a4b3a841a380 with identifier: DZ69774
2026-03-28 07:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d8d80f2-5540-5440-9e64-a4b3a841a380 with scrape type 2
2026-03-28 07:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d8d80f2-5540-5440-9e64-a4b3a841a380 with scrape type 2
2026-03-28 07:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d8d80f2-5540-5440-9e64-a4b3a841a380, identifier: DZ69774
2026-03-28 07:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d8d80f2-5540-5440-9e64-a4b3a841a380 with identifier: DZ69774
2026-03-28 07:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d8d80f2-5540-5440-9e64-a4b3a841a380 with identifier: DZ69774
2026-03-28 07:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d8d80f2-5540-5440-9e64-a4b3a841a380 with identifier: DZ69774 to the API
2026-03-28 07:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 132,
'expiration_date': '2026-03-28T16:18:32Z',
'fuel_type': 'petrol',
'id': '8d8d80f2-5540-5440-9e64-a4b3a841a380',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ69774',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 81818,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-21',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 Pure 2WD',
'transmission': 'manual',
'trim': 'Pure 2WD',
'year': 2019}
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ69774%27 HTTP/1.1" 200 None
2026-03-28 07:36:16 [auto1.de] INFO: Saving data for DZ69774: {'auction_closing_time': 1774714712.0, 'created_time': 1774466876.739505, 'last_price_update_time': 1774683376.263454}
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ69774') HTTP/1.1" 204 0
2026-03-28 07:36:16 [auto1.de] INFO: Found listing with ID: YR73965
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR73965%27 HTTP/1.1" 200 None
2026-03-28 07:36:16 [auto1.de] INFO: Scrape type for YR73965: 0
2026-03-28 07:36:16 [auto1.de] INFO: Found listing with ID: PH27110
2026-03-28 07:36:16 [auto1.de] INFO: Found listing with ID: TB77095
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB77095%27 HTTP/1.1" 200 None
2026-03-28 07:36:16 [auto1.de] INFO: Scrape type for TB77095: 0
2026-03-28 07:36:16 [auto1.de] INFO: Found listing with ID: JZ59846
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ59846%27 HTTP/1.1" 200 None
2026-03-28 07:36:16 [auto1.de] INFO: Scrape type for JZ59846: 2
2026-03-28 07:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dc22e7a-80b2-5407-8a69-7283324a0a65 with identifier: JZ59846
2026-03-28 07:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dc22e7a-80b2-5407-8a69-7283324a0a65 with scrape type 2
2026-03-28 07:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dc22e7a-80b2-5407-8a69-7283324a0a65 with scrape type 2
2026-03-28 07:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4dc22e7a-80b2-5407-8a69-7283324a0a65, identifier: JZ59846
2026-03-28 07:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4dc22e7a-80b2-5407-8a69-7283324a0a65 with identifier: JZ59846
2026-03-28 07:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4dc22e7a-80b2-5407-8a69-7283324a0a65 with identifier: JZ59846
2026-03-28 07:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4dc22e7a-80b2-5407-8a69-7283324a0a65 with identifier: JZ59846 to the API
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-28T16:21:46Z',
'fuel_type': 'diesel',
'id': '4dc22e7a-80b2-5407-8a69-7283324a0a65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ59846',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 72927,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-23',
'seller_name': None,
'title': 'Volkswagen Sharan 2.0 TDI IQ.DRIVE 4Motion',
'transmission': 'automatic',
'trim': 'IQ.DRIVE 4Motion',
'year': 2019}
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ59846%27 HTTP/1.1" 200 None
2026-03-28 07:36:16 [auto1.de] INFO: Saving data for JZ59846: {'auction_closing_time': 1774714906.0, 'created_time': 1773304610.57608, 'last_price_update_time': 1774683376.732507}
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ59846') HTTP/1.1" 204 0
2026-03-28 07:36:16 [auto1.de] INFO: Found listing with ID: DK81331
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81331%27 HTTP/1.1" 200 None
2026-03-28 07:36:16 [auto1.de] INFO: Scrape type for DK81331: 0
2026-03-28 07:36:16 [auto1.de] INFO: Found listing with ID: ML64265
2026-03-28 07:36:16 [auto1.de] INFO: Found listing with ID: GH20850
2026-03-28 07:36:16 [auto1.de] INFO: Found listing with ID: EA70059
2026-03-28 07:36:16 [auto1.de] INFO: Found listing with ID: JS64304
2026-03-28 07:36:16 [auto1.de] INFO: Found listing with ID: WB37074
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB37074%27 HTTP/1.1" 200 None
2026-03-28 07:36:16 [auto1.de] INFO: Scrape type for WB37074: 0
2026-03-28 07:36:16 [auto1.de] INFO: Found listing with ID: ML82340
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML82340%27 HTTP/1.1" 200 None
2026-03-28 07:36:16 [auto1.de] INFO: Scrape type for ML82340: 0
2026-03-28 07:36:16 [auto1.de] INFO: Found listing with ID: CL60178
2026-03-28 07:36:16 [auto1.de] INFO: Found listing with ID: HL40021
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL40021%27 HTTP/1.1" 200 None
2026-03-28 07:36:16 [auto1.de] INFO: Scrape type for HL40021: 0
2026-03-28 07:36:16 [auto1.de] INFO: Found listing with ID: GT12052
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT12052%27 HTTP/1.1" 200 None
2026-03-28 07:36:16 [auto1.de] INFO: Scrape type for GT12052: 0
2026-03-28 07:36:16 [auto1.de] INFO: Found listing with ID: ZL85266
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL85266%27 HTTP/1.1" 200 None
2026-03-28 07:36:16 [auto1.de] INFO: Scrape type for ZL85266: 0
2026-03-28 07:36:16 [auto1.de] INFO: Found listing with ID: XT10731
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT10731%27 HTTP/1.1" 200 None
2026-03-28 07:36:16 [auto1.de] INFO: Scrape type for XT10731: 2
2026-03-28 07:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fb31675-a703-5634-894d-cba726d21275 with identifier: XT10731
2026-03-28 07:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fb31675-a703-5634-894d-cba726d21275 with scrape type 2
2026-03-28 07:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fb31675-a703-5634-894d-cba726d21275 with scrape type 2
2026-03-28 07:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fb31675-a703-5634-894d-cba726d21275, identifier: XT10731
2026-03-28 07:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fb31675-a703-5634-894d-cba726d21275 with identifier: XT10731
2026-03-28 07:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fb31675-a703-5634-894d-cba726d21275 with identifier: XT10731
2026-03-28 07:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fb31675-a703-5634-894d-cba726d21275 with identifier: XT10731 to the API
2026-03-28 07:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 175,
'expiration_date': '2026-03-28T16:05:40Z',
'fuel_type': 'diesel',
'id': '1fb31675-a703-5634-894d-cba726d21275',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT10731',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 137644,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-11',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Sports-Line AWD',
'transmission': 'manual',
'trim': 'Sports-Line AWD',
'year': 2012}
2026-03-28 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT10731%27 HTTP/1.1" 200 None
2026-03-28 07:36:17 [auto1.de] INFO: Saving data for XT10731: {'auction_closing_time': 1774713940.0, 'created_time': 1774466448.983608, 'last_price_update_time': 1774683377.257815}
2026-03-28 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT10731') HTTP/1.1" 204 0
2026-03-28 07:36:17 [auto1.de] INFO: Found listing with ID: CW98774
2026-03-28 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW98774%27 HTTP/1.1" 200 None
2026-03-28 07:36:17 [auto1.de] INFO: Scrape type for CW98774: 0
2026-03-28 07:36:17 [auto1.de] INFO: Found listing with ID: CA15258
2026-03-28 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA15258%27 HTTP/1.1" 200 None
2026-03-28 07:36:17 [auto1.de] INFO: Scrape type for CA15258: 0
2026-03-28 07:36:17 [auto1.de] INFO: Found listing with ID: ZG64364
2026-03-28 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG64364%27 HTTP/1.1" 200 None
2026-03-28 07:36:17 [auto1.de] INFO: Scrape type for ZG64364: 2
2026-03-28 07:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d6ef44c-37ac-5613-a031-e41864695029 with identifier: ZG64364
2026-03-28 07:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d6ef44c-37ac-5613-a031-e41864695029 with scrape type 2
2026-03-28 07:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d6ef44c-37ac-5613-a031-e41864695029 with scrape type 2
2026-03-28 07:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d6ef44c-37ac-5613-a031-e41864695029, identifier: ZG64364
2026-03-28 07:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d6ef44c-37ac-5613-a031-e41864695029 with identifier: ZG64364
2026-03-28 07:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d6ef44c-37ac-5613-a031-e41864695029 with identifier: ZG64364
2026-03-28 07:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d6ef44c-37ac-5613-a031-e41864695029 with identifier: ZG64364 to the API
2026-03-28 07:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:10:35Z',
'fuel_type': 'petrol',
'id': '0d6ef44c-37ac-5613-a031-e41864695029',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG64364',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 42937,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-12',
'seller_name': None,
'title': 'Skoda Fabia 1.2 TSI Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2014}
2026-03-28 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG64364%27 HTTP/1.1" 200 None
2026-03-28 07:36:18 [auto1.de] INFO: Saving data for ZG64364: {'auction_closing_time': 1774714235.0, 'created_time': 1774468025.209122, 'last_price_update_time': 1774683378.761179}
2026-03-28 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG64364') HTTP/1.1" 204 0
2026-03-28 07:36:18 [auto1.de] INFO: Found listing with ID: WN92632
2026-03-28 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN92632%27 HTTP/1.1" 200 None
2026-03-28 07:36:18 [auto1.de] INFO: Scrape type for WN92632: 0
2026-03-28 07:36:18 [auto1.de] INFO: Found listing with ID: NM07920
2026-03-28 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM07920%27 HTTP/1.1" 200 None
2026-03-28 07:36:18 [auto1.de] INFO: Scrape type for NM07920: 0
2026-03-28 07:36:18 [auto1.de] INFO: Found listing with ID: BP47263
2026-03-28 07:36:18 [auto1.de] INFO: Found listing with ID: HS50383
2026-03-28 07:36:18 [auto1.de] INFO: Found listing with ID: BV07882
2026-03-28 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV07882%27 HTTP/1.1" 200 None
2026-03-28 07:36:18 [auto1.de] INFO: Scrape type for BV07882: 2
2026-03-28 07:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72c6595c-0f5c-5840-9b79-9f50ec536aed with identifier: BV07882
2026-03-28 07:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72c6595c-0f5c-5840-9b79-9f50ec536aed with scrape type 2
2026-03-28 07:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72c6595c-0f5c-5840-9b79-9f50ec536aed with scrape type 2
2026-03-28 07:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72c6595c-0f5c-5840-9b79-9f50ec536aed, identifier: BV07882
2026-03-28 07:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72c6595c-0f5c-5840-9b79-9f50ec536aed with identifier: BV07882
2026-03-28 07:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72c6595c-0f5c-5840-9b79-9f50ec536aed with identifier: BV07882
2026-03-28 07:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72c6595c-0f5c-5840-9b79-9f50ec536aed with identifier: BV07882 to the API
2026-03-28 07:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:53:55Z',
'fuel_type': 'petrol',
'id': '72c6595c-0f5c-5840-9b79-9f50ec536aed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV07882',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 57551,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-29',
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2019}
2026-03-28 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV07882%27 HTTP/1.1" 200 None
2026-03-28 07:36:20 [auto1.de] INFO: Saving data for BV07882: {'auction_closing_time': 1774716835.0, 'created_time': 1774467877.623955, 'last_price_update_time': 1774683380.456899}
2026-03-28 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV07882') HTTP/1.1" 204 0
2026-03-28 07:36:20 [auto1.de] INFO: Found listing with ID: XZ81913
2026-03-28 07:36:20 [auto1.de] INFO: Found listing with ID: UB19206
2026-03-28 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB19206%27 HTTP/1.1" 200 None
2026-03-28 07:36:20 [auto1.de] INFO: Scrape type for UB19206: 0
2026-03-28 07:36:20 [auto1.de] INFO: Found listing with ID: TG50792
2026-03-28 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG50792%27 HTTP/1.1" 200 None
2026-03-28 07:36:20 [auto1.de] INFO: Scrape type for TG50792: 0
2026-03-28 07:36:20 [auto1.de] INFO: Found listing with ID: NB15408
2026-03-28 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB15408%27 HTTP/1.1" 200 None
2026-03-28 07:36:20 [auto1.de] INFO: Scrape type for NB15408: 0
2026-03-28 07:36:20 [auto1.de] INFO: Channel: 24h | Page: 70 | totalHits: 9255 | hits on page: 40
2026-03-28 07:36:20 [auto1.de] INFO: Found listing with ID: HC41617
2026-03-28 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC41617%27 HTTP/1.1" 200 None
2026-03-28 07:36:20 [auto1.de] INFO: Scrape type for HC41617: 0
2026-03-28 07:36:20 [auto1.de] INFO: Found listing with ID: YE23414
2026-03-28 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE23414%27 HTTP/1.1" 200 None
2026-03-28 07:36:20 [auto1.de] INFO: Scrape type for YE23414: 0
2026-03-28 07:36:20 [auto1.de] INFO: Found listing with ID: ZT65198
2026-03-28 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT65198%27 HTTP/1.1" 200 None
2026-03-28 07:36:20 [auto1.de] INFO: Scrape type for ZT65198: 2
2026-03-28 07:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11be537e-4344-536a-bd3c-a1b9e6c59ba9 with identifier: ZT65198
2026-03-28 07:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11be537e-4344-536a-bd3c-a1b9e6c59ba9 with scrape type 2
2026-03-28 07:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11be537e-4344-536a-bd3c-a1b9e6c59ba9 with scrape type 2
2026-03-28 07:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11be537e-4344-536a-bd3c-a1b9e6c59ba9, identifier: ZT65198
2026-03-28 07:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11be537e-4344-536a-bd3c-a1b9e6c59ba9 with identifier: ZT65198
2026-03-28 07:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11be537e-4344-536a-bd3c-a1b9e6c59ba9 with identifier: ZT65198
2026-03-28 07:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11be537e-4344-536a-bd3c-a1b9e6c59ba9 with identifier: ZT65198 to the API
2026-03-28 07:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:17:54Z',
'fuel_type': 'petrol',
'id': '11be537e-4344-536a-bd3c-a1b9e6c59ba9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT65198',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 148667,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-13',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-28 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT65198%27 HTTP/1.1" 200 None
2026-03-28 07:36:21 [auto1.de] INFO: Saving data for ZT65198: {'auction_closing_time': 1774714674.0, 'created_time': 1774466902.67659, 'last_price_update_time': 1774683381.444136}
2026-03-28 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT65198') HTTP/1.1" 204 0
2026-03-28 07:36:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:36:21 [auto1.de] INFO: Found listing with ID: FY46967
2026-03-28 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY46967%27 HTTP/1.1" 200 None
2026-03-28 07:36:21 [auto1.de] INFO: Scrape type for FY46967: 0
2026-03-28 07:36:21 [auto1.de] INFO: Found listing with ID: GL26328
2026-03-28 07:36:21 [auto1.de] INFO: Found listing with ID: DU86117
2026-03-28 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU86117%27 HTTP/1.1" 200 None
2026-03-28 07:36:21 [auto1.de] INFO: Scrape type for DU86117: 0
2026-03-28 07:36:21 [auto1.de] INFO: Found listing with ID: TH75068
2026-03-28 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH75068%27 HTTP/1.1" 200 None
2026-03-28 07:36:21 [auto1.de] INFO: Scrape type for TH75068: 0
2026-03-28 07:36:21 [auto1.de] INFO: Found listing with ID: AF99280
2026-03-28 07:36:21 [auto1.de] INFO: Found listing with ID: HZ75916
2026-03-28 07:36:21 [auto1.de] INFO: Found listing with ID: HE65946
2026-03-28 07:36:21 [auto1.de] INFO: Found listing with ID: GC11605
2026-03-28 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC11605%27 HTTP/1.1" 200 None
2026-03-28 07:36:21 [auto1.de] INFO: Scrape type for GC11605: 0
2026-03-28 07:36:21 [auto1.de] INFO: Found listing with ID: NY45531
2026-03-28 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY45531%27 HTTP/1.1" 200 None
2026-03-28 07:36:21 [auto1.de] INFO: Scrape type for NY45531: 0
2026-03-28 07:36:21 [auto1.de] INFO: Found listing with ID: LL46180
2026-03-28 07:36:21 [auto1.de] INFO: Found listing with ID: NE31655
2026-03-28 07:36:21 [auto1.de] INFO: Found listing with ID: FF33829
2026-03-28 07:36:21 [auto1.de] INFO: Found listing with ID: LC24669
2026-03-28 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC24669%27 HTTP/1.1" 200 None
2026-03-28 07:36:21 [auto1.de] INFO: Scrape type for LC24669: 0
2026-03-28 07:36:21 [auto1.de] INFO: Found listing with ID: LY01980
2026-03-28 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY01980%27 HTTP/1.1" 200 None
2026-03-28 07:36:21 [auto1.de] INFO: Scrape type for LY01980: 2
2026-03-28 07:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 388d1a2f-2a80-5bac-a834-481b1ecf30ee with identifier: LY01980
2026-03-28 07:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 388d1a2f-2a80-5bac-a834-481b1ecf30ee with scrape type 2
2026-03-28 07:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 388d1a2f-2a80-5bac-a834-481b1ecf30ee with scrape type 2
2026-03-28 07:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 388d1a2f-2a80-5bac-a834-481b1ecf30ee, identifier: LY01980
2026-03-28 07:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 388d1a2f-2a80-5bac-a834-481b1ecf30ee with identifier: LY01980
2026-03-28 07:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 388d1a2f-2a80-5bac-a834-481b1ecf30ee with identifier: LY01980
2026-03-28 07:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 388d1a2f-2a80-5bac-a834-481b1ecf30ee with identifier: LY01980 to the API
2026-03-28 07:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:36:20Z',
'fuel_type': 'petrol',
'id': '388d1a2f-2a80-5bac-a834-481b1ecf30ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY01980',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 145573,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-03-03',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 Avantgarde',
'transmission': 'manual',
'trim': 'Avantgarde',
'year': 2005}
2026-03-28 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY01980%27 HTTP/1.1" 200 None
2026-03-28 07:36:22 [auto1.de] INFO: Saving data for LY01980: {'auction_closing_time': 1774715780.0, 'created_time': 1774466942.547118, 'last_price_update_time': 1774683382.813655}
2026-03-28 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LY01980') HTTP/1.1" 204 0
2026-03-28 07:36:22 [auto1.de] INFO: Found listing with ID: TP41556
2026-03-28 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP41556%27 HTTP/1.1" 200 None
2026-03-28 07:36:22 [auto1.de] INFO: Scrape type for TP41556: 0
2026-03-28 07:36:22 [auto1.de] INFO: Found listing with ID: GG09705
2026-03-28 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG09705%27 HTTP/1.1" 200 None
2026-03-28 07:36:22 [auto1.de] INFO: Scrape type for GG09705: 0
2026-03-28 07:36:22 [auto1.de] INFO: Found listing with ID: VL46030
2026-03-28 07:36:22 [auto1.de] INFO: Found listing with ID: TW00393
2026-03-28 07:36:22 [auto1.de] INFO: Found listing with ID: BK38735
2026-03-28 07:36:22 [auto1.de] INFO: Found listing with ID: AV40802
2026-03-28 07:36:22 [auto1.de] INFO: Found listing with ID: TH33343
2026-03-28 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH33343%27 HTTP/1.1" 200 None
2026-03-28 07:36:22 [auto1.de] INFO: Scrape type for TH33343: 0
2026-03-28 07:36:22 [auto1.de] INFO: Found listing with ID: AJ16531
2026-03-28 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ16531%27 HTTP/1.1" 200 None
2026-03-28 07:36:22 [auto1.de] INFO: Scrape type for AJ16531: 0
2026-03-28 07:36:22 [auto1.de] INFO: Found listing with ID: EZ76409
2026-03-28 07:36:22 [auto1.de] INFO: Found listing with ID: FK95510
2026-03-28 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK95510%27 HTTP/1.1" 200 None
2026-03-28 07:36:22 [auto1.de] INFO: Scrape type for FK95510: 0
2026-03-28 07:36:22 [auto1.de] INFO: Found listing with ID: YU70640
2026-03-28 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU70640%27 HTTP/1.1" 200 None
2026-03-28 07:36:23 [auto1.de] INFO: Scrape type for YU70640: 0
2026-03-28 07:36:23 [auto1.de] INFO: Found listing with ID: MY07793
2026-03-28 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY07793%27 HTTP/1.1" 200 None
2026-03-28 07:36:23 [auto1.de] INFO: Scrape type for MY07793: 0
2026-03-28 07:36:23 [auto1.de] INFO: Found listing with ID: JM29526
2026-03-28 07:36:23 [auto1.de] INFO: Found listing with ID: AE64290
2026-03-28 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE64290%27 HTTP/1.1" 200 None
2026-03-28 07:36:23 [auto1.de] INFO: Scrape type for AE64290: 0
2026-03-28 07:36:23 [auto1.de] INFO: Found listing with ID: SS89837
2026-03-28 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS89837%27 HTTP/1.1" 200 None
2026-03-28 07:36:23 [auto1.de] INFO: Scrape type for SS89837: 0
2026-03-28 07:36:23 [auto1.de] INFO: Found listing with ID: WS21373
2026-03-28 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS21373%27 HTTP/1.1" 200 None
2026-03-28 07:36:23 [auto1.de] INFO: Scrape type for WS21373: 0
2026-03-28 07:36:23 [auto1.de] INFO: Found listing with ID: UV26569
2026-03-28 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV26569%27 HTTP/1.1" 200 None
2026-03-28 07:36:23 [auto1.de] INFO: Scrape type for UV26569: 0
2026-03-28 07:36:23 [auto1.de] INFO: Found listing with ID: UU82281
2026-03-28 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU82281%27 HTTP/1.1" 200 None
2026-03-28 07:36:23 [auto1.de] INFO: Scrape type for UU82281: 0
2026-03-28 07:36:23 [auto1.de] INFO: Found listing with ID: FB95771
2026-03-28 07:36:23 [auto1.de] INFO: Found listing with ID: VZ69122
2026-03-28 07:36:23 [auto1.de] INFO: Found listing with ID: UW12612
2026-03-28 07:36:23 [auto1.de] INFO: Found listing with ID: XK50877
2026-03-28 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK50877%27 HTTP/1.1" 200 None
2026-03-28 07:36:23 [auto1.de] INFO: Scrape type for XK50877: 0
2026-03-28 07:36:23 [auto1.de] INFO: Found listing with ID: MU43821
2026-03-28 07:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:36:24 [auto1.de] INFO: Channel: 24h | Page: 71 | totalHits: 9255 | hits on page: 40
2026-03-28 07:36:24 [auto1.de] INFO: Found listing with ID: RT09261
2026-03-28 07:36:24 [auto1.de] INFO: Found listing with ID: YF97500
2026-03-28 07:36:24 [auto1.de] INFO: Found listing with ID: RU37876
2026-03-28 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU37876%27 HTTP/1.1" 200 None
2026-03-28 07:36:24 [auto1.de] INFO: Scrape type for RU37876: 0
2026-03-28 07:36:24 [auto1.de] INFO: Found listing with ID: PG24106
2026-03-28 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24106%27 HTTP/1.1" 200 None
2026-03-28 07:36:24 [auto1.de] INFO: Scrape type for PG24106: 2
2026-03-28 07:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc1d44eb-f50b-5930-8967-51a7f31625ad with identifier: PG24106
2026-03-28 07:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc1d44eb-f50b-5930-8967-51a7f31625ad with scrape type 2
2026-03-28 07:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc1d44eb-f50b-5930-8967-51a7f31625ad with scrape type 2
2026-03-28 07:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc1d44eb-f50b-5930-8967-51a7f31625ad, identifier: PG24106
2026-03-28 07:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc1d44eb-f50b-5930-8967-51a7f31625ad with identifier: PG24106
2026-03-28 07:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc1d44eb-f50b-5930-8967-51a7f31625ad with identifier: PG24106
2026-03-28 07:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc1d44eb-f50b-5930-8967-51a7f31625ad with identifier: PG24106 to the API
2026-03-28 07:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:37:30Z',
'fuel_type': 'diesel',
'id': 'dc1d44eb-f50b-5930-8967-51a7f31625ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG24106',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 214766,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-17',
'seller_name': None,
'title': 'Seat Leon 1.6 TDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2014}
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24106%27 HTTP/1.1" 200 None
2026-03-28 07:36:27 [auto1.de] INFO: Saving data for PG24106: {'auction_closing_time': 1774715850.0, 'created_time': 1774464876.21831, 'last_price_update_time': 1774683387.157498}
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG24106') HTTP/1.1" 204 0
2026-03-28 07:36:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:36:27 [auto1.de] INFO: Found listing with ID: JL53088
2026-03-28 07:36:27 [auto1.de] INFO: Found listing with ID: MX86281
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX86281%27 HTTP/1.1" 200 None
2026-03-28 07:36:27 [auto1.de] INFO: Scrape type for MX86281: 0
2026-03-28 07:36:27 [auto1.de] INFO: Found listing with ID: VT41344
2026-03-28 07:36:27 [auto1.de] INFO: Found listing with ID: KE90255
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90255%27 HTTP/1.1" 200 None
2026-03-28 07:36:27 [auto1.de] INFO: Scrape type for KE90255: 0
2026-03-28 07:36:27 [auto1.de] INFO: Found listing with ID: UA17642
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA17642%27 HTTP/1.1" 200 None
2026-03-28 07:36:27 [auto1.de] INFO: Scrape type for UA17642: 0
2026-03-28 07:36:27 [auto1.de] INFO: Found listing with ID: RD87783
2026-03-28 07:36:27 [auto1.de] INFO: Found listing with ID: BV34042
2026-03-28 07:36:27 [auto1.de] INFO: Found listing with ID: AP11154
2026-03-28 07:36:27 [auto1.de] INFO: Found listing with ID: CZ93275
2026-03-28 07:36:27 [auto1.de] INFO: Found listing with ID: MT27523
2026-03-28 07:36:27 [auto1.de] INFO: Found listing with ID: PX90608
2026-03-28 07:36:27 [auto1.de] INFO: Found listing with ID: RM28655
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM28655%27 HTTP/1.1" 200 None
2026-03-28 07:36:27 [auto1.de] INFO: Scrape type for RM28655: 0
2026-03-28 07:36:27 [auto1.de] INFO: Found listing with ID: KG59936
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG59936%27 HTTP/1.1" 200 None
2026-03-28 07:36:27 [auto1.de] INFO: Scrape type for KG59936: 0
2026-03-28 07:36:27 [auto1.de] INFO: Found listing with ID: CS78773
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS78773%27 HTTP/1.1" 200 None
2026-03-28 07:36:27 [auto1.de] INFO: Scrape type for CS78773: 0
2026-03-28 07:36:27 [auto1.de] INFO: Found listing with ID: SN35212
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN35212%27 HTTP/1.1" 200 None
2026-03-28 07:36:27 [auto1.de] INFO: Scrape type for SN35212: 0
2026-03-28 07:36:27 [auto1.de] INFO: Found listing with ID: HU03787
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU03787%27 HTTP/1.1" 200 None
2026-03-28 07:36:27 [auto1.de] INFO: Scrape type for HU03787: 2
2026-03-28 07:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16e834d7-0e82-55e4-8571-f40de708a15f with identifier: HU03787
2026-03-28 07:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16e834d7-0e82-55e4-8571-f40de708a15f with scrape type 2
2026-03-28 07:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16e834d7-0e82-55e4-8571-f40de708a15f with scrape type 2
2026-03-28 07:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 16e834d7-0e82-55e4-8571-f40de708a15f, identifier: HU03787
2026-03-28 07:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 16e834d7-0e82-55e4-8571-f40de708a15f with identifier: HU03787
2026-03-28 07:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 16e834d7-0e82-55e4-8571-f40de708a15f with identifier: HU03787
2026-03-28 07:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 16e834d7-0e82-55e4-8571-f40de708a15f with identifier: HU03787 to the API
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:55:46Z',
'fuel_type': 'petrol',
'id': '16e834d7-0e82-55e4-8571-f40de708a15f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU03787',
'listing': 'auction',
'make': 'Renault',
'model': 'Modus',
'odometer': 75245,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-10-31',
'seller_name': None,
'title': 'Renault Modus 1.2 Authentique',
'transmission': 'manual',
'trim': 'Authentique',
'year': 2005}
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU03787%27 HTTP/1.1" 200 None
2026-03-28 07:36:27 [auto1.de] INFO: Saving data for HU03787: {'auction_closing_time': 1774716946.0, 'created_time': 1774467260.413283, 'last_price_update_time': 1774683387.90008}
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU03787') HTTP/1.1" 204 0
2026-03-28 07:36:28 [auto1.de] INFO: Found listing with ID: VU91072
2026-03-28 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU91072%27 HTTP/1.1" 200 None
2026-03-28 07:36:28 [auto1.de] INFO: Scrape type for VU91072: 0
2026-03-28 07:36:28 [auto1.de] INFO: Found listing with ID: DP30062
2026-03-28 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP30062%27 HTTP/1.1" 200 None
2026-03-28 07:36:28 [auto1.de] INFO: Scrape type for DP30062: 0
2026-03-28 07:36:28 [auto1.de] INFO: Found listing with ID: MN64369
2026-03-28 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN64369%27 HTTP/1.1" 200 None
2026-03-28 07:36:28 [auto1.de] INFO: Scrape type for MN64369: 0
2026-03-28 07:36:28 [auto1.de] INFO: Found listing with ID: ED76181
2026-03-28 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED76181%27 HTTP/1.1" 200 None
2026-03-28 07:36:28 [auto1.de] INFO: Scrape type for ED76181: 0
2026-03-28 07:36:28 [auto1.de] INFO: Found listing with ID: RF79085
2026-03-28 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF79085%27 HTTP/1.1" 200 None
2026-03-28 07:36:28 [auto1.de] INFO: Scrape type for RF79085: 0
2026-03-28 07:36:28 [auto1.de] INFO: Found listing with ID: RN08070
2026-03-28 07:36:28 [auto1.de] INFO: Found listing with ID: WC28645
2026-03-28 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC28645%27 HTTP/1.1" 200 None
2026-03-28 07:36:28 [auto1.de] INFO: Scrape type for WC28645: 0
2026-03-28 07:36:28 [auto1.de] INFO: Found listing with ID: RV28657
2026-03-28 07:36:28 [auto1.de] INFO: Found listing with ID: KW34435
2026-03-28 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW34435%27 HTTP/1.1" 200 None
2026-03-28 07:36:28 [auto1.de] INFO: Scrape type for KW34435: 0
2026-03-28 07:36:28 [auto1.de] INFO: Found listing with ID: RK34860
2026-03-28 07:36:28 [auto1.de] INFO: Found listing with ID: GF47308
2026-03-28 07:36:28 [auto1.de] INFO: Found listing with ID: UY63030
2026-03-28 07:36:28 [auto1.de] INFO: Found listing with ID: ME06173
2026-03-28 07:36:28 [auto1.de] INFO: Found listing with ID: NP40069
2026-03-28 07:36:28 [auto1.de] INFO: Found listing with ID: JB31232
2026-03-28 07:36:28 [auto1.de] INFO: Found listing with ID: LU32216
2026-03-28 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU32216%27 HTTP/1.1" 200 None
2026-03-28 07:36:28 [auto1.de] INFO: Scrape type for LU32216: 0
2026-03-28 07:36:28 [auto1.de] INFO: Found listing with ID: WX65526
2026-03-28 07:36:28 [auto1.de] INFO: Found listing with ID: TG18023
2026-03-28 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG18023%27 HTTP/1.1" 200 None
2026-03-28 07:36:28 [auto1.de] INFO: Scrape type for TG18023: 0
2026-03-28 07:36:28 [auto1.de] INFO: Found listing with ID: FN23082
2026-03-28 07:36:28 [auto1.de] INFO: Found listing with ID: PP57494
2026-03-28 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP57494%27 HTTP/1.1" 200 None
2026-03-28 07:36:28 [auto1.de] INFO: Scrape type for PP57494: 0
2026-03-28 07:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:36:29 [auto1.de] INFO: Channel: 24h | Page: 72 | totalHits: 9256 | hits on page: 40
2026-03-28 07:36:29 [auto1.de] INFO: Found listing with ID: PP57494
2026-03-28 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP57494%27 HTTP/1.1" 200 None
2026-03-28 07:36:29 [auto1.de] INFO: Scrape type for PP57494: 0
2026-03-28 07:36:29 [auto1.de] INFO: Found listing with ID: NU57672
2026-03-28 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU57672%27 HTTP/1.1" 200 None
2026-03-28 07:36:29 [auto1.de] INFO: Scrape type for NU57672: 0
2026-03-28 07:36:29 [auto1.de] INFO: Found listing with ID: NX98463
2026-03-28 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX98463%27 HTTP/1.1" 200 None
2026-03-28 07:36:29 [auto1.de] INFO: Scrape type for NX98463: 2
2026-03-28 07:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e976d4be-4761-5220-bf38-edd35de764f0 with identifier: NX98463
2026-03-28 07:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e976d4be-4761-5220-bf38-edd35de764f0 with scrape type 2
2026-03-28 07:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e976d4be-4761-5220-bf38-edd35de764f0 with scrape type 2
2026-03-28 07:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e976d4be-4761-5220-bf38-edd35de764f0, identifier: NX98463
2026-03-28 07:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e976d4be-4761-5220-bf38-edd35de764f0 with identifier: NX98463
2026-03-28 07:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e976d4be-4761-5220-bf38-edd35de764f0 with identifier: NX98463
2026-03-28 07:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e976d4be-4761-5220-bf38-edd35de764f0 with identifier: NX98463 to the API
2026-03-28 07:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 320,
'expiration_date': '2026-03-28T16:10:21Z',
'fuel_type': 'hybrid',
'id': 'e976d4be-4761-5220-bf38-edd35de764f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX98463',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 71322,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-06',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 300e 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2020}
2026-03-28 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX98463%27 HTTP/1.1" 200 None
2026-03-28 07:36:30 [auto1.de] INFO: Saving data for NX98463: {'auction_closing_time': 1774714221.0, 'created_time': 1774467282.389388, 'last_price_update_time': 1774683390.358568}
2026-03-28 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX98463') HTTP/1.1" 204 0
2026-03-28 07:36:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:36:30 [auto1.de] INFO: Found listing with ID: BW69940
2026-03-28 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW69940%27 HTTP/1.1" 200 None
2026-03-28 07:36:30 [auto1.de] INFO: Scrape type for BW69940: 0
2026-03-28 07:36:30 [auto1.de] INFO: Found listing with ID: BH79353
2026-03-28 07:36:30 [auto1.de] INFO: Found listing with ID: EV47698
2026-03-28 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV47698%27 HTTP/1.1" 200 None
2026-03-28 07:36:30 [auto1.de] INFO: Scrape type for EV47698: 0
2026-03-28 07:36:30 [auto1.de] INFO: Found listing with ID: LR04011
2026-03-28 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR04011%27 HTTP/1.1" 200 None
2026-03-28 07:36:30 [auto1.de] INFO: Scrape type for LR04011: 0
2026-03-28 07:36:30 [auto1.de] INFO: Found listing with ID: CK66212
2026-03-28 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK66212%27 HTTP/1.1" 200 None
2026-03-28 07:36:30 [auto1.de] INFO: Scrape type for CK66212: 0
2026-03-28 07:36:30 [auto1.de] INFO: Found listing with ID: LS52090
2026-03-28 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS52090%27 HTTP/1.1" 200 None
2026-03-28 07:36:30 [auto1.de] INFO: Scrape type for LS52090: 2
2026-03-28 07:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d1c852a-cd16-516b-a0ea-0a027db6854f with identifier: LS52090
2026-03-28 07:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d1c852a-cd16-516b-a0ea-0a027db6854f with scrape type 2
2026-03-28 07:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d1c852a-cd16-516b-a0ea-0a027db6854f with scrape type 2
2026-03-28 07:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d1c852a-cd16-516b-a0ea-0a027db6854f, identifier: LS52090
2026-03-28 07:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d1c852a-cd16-516b-a0ea-0a027db6854f with identifier: LS52090
2026-03-28 07:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d1c852a-cd16-516b-a0ea-0a027db6854f with identifier: LS52090
2026-03-28 07:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d1c852a-cd16-516b-a0ea-0a027db6854f with identifier: LS52090 to the API
2026-03-28 07:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 80,
'expiration_date': '2026-03-28T16:53:00Z',
'fuel_type': 'petrol',
'id': '1d1c852a-cd16-516b-a0ea-0a027db6854f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS52090',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 105550,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-11-12',
'seller_name': None,
'title': 'Opel Corsa 1.2 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2007}
2026-03-28 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS52090%27 HTTP/1.1" 200 None
2026-03-28 07:36:31 [auto1.de] INFO: Saving data for LS52090: {'auction_closing_time': 1774716780.0, 'created_time': 1774467679.962283, 'last_price_update_time': 1774683391.987661}
2026-03-28 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS52090') HTTP/1.1" 204 0
2026-03-28 07:36:32 [auto1.de] INFO: Found listing with ID: ZT39805
2026-03-28 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT39805%27 HTTP/1.1" 200 None
2026-03-28 07:36:32 [auto1.de] INFO: Scrape type for ZT39805: 2
2026-03-28 07:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82bd2f54-d9fc-5c87-a743-3370a5d63bcb with identifier: ZT39805
2026-03-28 07:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82bd2f54-d9fc-5c87-a743-3370a5d63bcb with scrape type 2
2026-03-28 07:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82bd2f54-d9fc-5c87-a743-3370a5d63bcb with scrape type 2
2026-03-28 07:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82bd2f54-d9fc-5c87-a743-3370a5d63bcb, identifier: ZT39805
2026-03-28 07:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82bd2f54-d9fc-5c87-a743-3370a5d63bcb with identifier: ZT39805
2026-03-28 07:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82bd2f54-d9fc-5c87-a743-3370a5d63bcb with identifier: ZT39805
2026-03-28 07:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82bd2f54-d9fc-5c87-a743-3370a5d63bcb with identifier: ZT39805 to the API
2026-03-28 07:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:22:43Z',
'fuel_type': 'diesel',
'id': '82bd2f54-d9fc-5c87-a743-3370a5d63bcb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT39805',
'listing': 'auction',
'make': 'Ford',
'model': 'Tourneo Custom',
'odometer': 62801,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-09',
'seller_name': None,
'title': 'Ford Tourneo Custom 2.0 TDCi 320 L1 Tourneo Titanium',
'transmission': 'automatic',
'trim': '320 L1 Tourneo Titanium',
'year': 2019}
2026-03-28 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT39805%27 HTTP/1.1" 200 None
2026-03-28 07:36:32 [auto1.de] INFO: Saving data for ZT39805: {'auction_closing_time': 1774714963.0, 'created_time': 1774466098.826055, 'last_price_update_time': 1774683392.485417}
2026-03-28 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT39805') HTTP/1.1" 204 0
2026-03-28 07:36:32 [auto1.de] INFO: Found listing with ID: RR35143
2026-03-28 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR35143%27 HTTP/1.1" 200 None
2026-03-28 07:36:32 [auto1.de] INFO: Scrape type for RR35143: 0
2026-03-28 07:36:32 [auto1.de] INFO: Found listing with ID: XF59932
2026-03-28 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF59932%27 HTTP/1.1" 200 None
2026-03-28 07:36:32 [auto1.de] INFO: Scrape type for XF59932: 0
2026-03-28 07:36:32 [auto1.de] INFO: Found listing with ID: ZG00805
2026-03-28 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG00805%27 HTTP/1.1" 200 None
2026-03-28 07:36:32 [auto1.de] INFO: Scrape type for ZG00805: 0
2026-03-28 07:36:32 [auto1.de] INFO: Found listing with ID: BN46018
2026-03-28 07:36:32 [auto1.de] INFO: Found listing with ID: NZ21452
2026-03-28 07:36:32 [auto1.de] INFO: Found listing with ID: EB21377
2026-03-28 07:36:32 [auto1.de] INFO: Found listing with ID: LG14715
2026-03-28 07:36:32 [auto1.de] INFO: Found listing with ID: MW19833
2026-03-28 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW19833%27 HTTP/1.1" 200 None
2026-03-28 07:36:32 [auto1.de] INFO: Scrape type for MW19833: 0
2026-03-28 07:36:32 [auto1.de] INFO: Found listing with ID: XR23222
2026-03-28 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR23222%27 HTTP/1.1" 200 None
2026-03-28 07:36:32 [auto1.de] INFO: Scrape type for XR23222: 2
2026-03-28 07:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c04f38d-25bd-5ef1-82ca-11b8e448d7c5 with identifier: XR23222
2026-03-28 07:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c04f38d-25bd-5ef1-82ca-11b8e448d7c5 with scrape type 2
2026-03-28 07:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c04f38d-25bd-5ef1-82ca-11b8e448d7c5 with scrape type 2
2026-03-28 07:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c04f38d-25bd-5ef1-82ca-11b8e448d7c5, identifier: XR23222
2026-03-28 07:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c04f38d-25bd-5ef1-82ca-11b8e448d7c5 with identifier: XR23222
2026-03-28 07:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c04f38d-25bd-5ef1-82ca-11b8e448d7c5 with identifier: XR23222
2026-03-28 07:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c04f38d-25bd-5ef1-82ca-11b8e448d7c5 with identifier: XR23222 to the API
2026-03-28 07:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 235,
'expiration_date': '2026-03-28T16:16:21Z',
'fuel_type': 'diesel',
'id': '2c04f38d-25bd-5ef1-82ca-11b8e448d7c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR23222',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC90',
'odometer': 160108,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-08',
'seller_name': None,
'title': 'Volvo XC90 2.0 D5 Momentum AWD',
'transmission': 'automatic',
'trim': 'Momentum AWD',
'year': 2018}
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR23222%27 HTTP/1.1" 200 None
2026-03-28 07:36:33 [auto1.de] INFO: Saving data for XR23222: {'auction_closing_time': 1774714581.0, 'created_time': 1774464028.657902, 'last_price_update_time': 1774683393.118882}
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR23222') HTTP/1.1" 204 0
2026-03-28 07:36:33 [auto1.de] INFO: Found listing with ID: AW57612
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW57612%27 HTTP/1.1" 200 None
2026-03-28 07:36:33 [auto1.de] INFO: Scrape type for AW57612: 0
2026-03-28 07:36:33 [auto1.de] INFO: Found listing with ID: UE61705
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE61705%27 HTTP/1.1" 200 None
2026-03-28 07:36:33 [auto1.de] INFO: Scrape type for UE61705: 0
2026-03-28 07:36:33 [auto1.de] INFO: Found listing with ID: VV06990
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV06990%27 HTTP/1.1" 200 None
2026-03-28 07:36:33 [auto1.de] INFO: Scrape type for VV06990: 0
2026-03-28 07:36:33 [auto1.de] INFO: Found listing with ID: PV23969
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV23969%27 HTTP/1.1" 200 None
2026-03-28 07:36:33 [auto1.de] INFO: Scrape type for PV23969: 0
2026-03-28 07:36:33 [auto1.de] INFO: Found listing with ID: VP95925
2026-03-28 07:36:33 [auto1.de] INFO: Found listing with ID: EJ11431
2026-03-28 07:36:33 [auto1.de] INFO: Found listing with ID: YF17855
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF17855%27 HTTP/1.1" 200 None
2026-03-28 07:36:33 [auto1.de] INFO: Scrape type for YF17855: 0
2026-03-28 07:36:33 [auto1.de] INFO: Found listing with ID: HV72401
2026-03-28 07:36:33 [auto1.de] INFO: Found listing with ID: FX38179
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX38179%27 HTTP/1.1" 200 None
2026-03-28 07:36:33 [auto1.de] INFO: Scrape type for FX38179: 0
2026-03-28 07:36:33 [auto1.de] INFO: Found listing with ID: KZ72468
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ72468%27 HTTP/1.1" 200 None
2026-03-28 07:36:33 [auto1.de] INFO: Scrape type for KZ72468: 2
2026-03-28 07:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff375818-da06-5c4d-a62a-ba1923030206 with identifier: KZ72468
2026-03-28 07:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff375818-da06-5c4d-a62a-ba1923030206 with scrape type 2
2026-03-28 07:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff375818-da06-5c4d-a62a-ba1923030206 with scrape type 2
2026-03-28 07:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff375818-da06-5c4d-a62a-ba1923030206, identifier: KZ72468
2026-03-28 07:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff375818-da06-5c4d-a62a-ba1923030206 with identifier: KZ72468
2026-03-28 07:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff375818-da06-5c4d-a62a-ba1923030206 with identifier: KZ72468
2026-03-28 07:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff375818-da06-5c4d-a62a-ba1923030206 with identifier: KZ72468 to the API
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:08:08Z',
'fuel_type': 'diesel',
'id': 'ff375818-da06-5c4d-a62a-ba1923030206',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ72468',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 96384,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-24',
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 290 L1 Sport',
'transmission': 'manual',
'trim': '290 L1 Sport',
'year': 2018}
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ72468%27 HTTP/1.1" 200 None
2026-03-28 07:36:33 [auto1.de] INFO: Saving data for KZ72468: {'auction_closing_time': 1774714088.0, 'created_time': 1774466695.018777, 'last_price_update_time': 1774683393.81185}
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ72468') HTTP/1.1" 204 0
2026-03-28 07:36:33 [auto1.de] INFO: Found listing with ID: NX37466
2026-03-28 07:36:33 [auto1.de] INFO: Found listing with ID: NZ91667
2026-03-28 07:36:33 [auto1.de] INFO: Found listing with ID: GN02679
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN02679%27 HTTP/1.1" 200 None
2026-03-28 07:36:33 [auto1.de] INFO: Scrape type for GN02679: 0
2026-03-28 07:36:33 [auto1.de] INFO: Found listing with ID: MW52698
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW52698%27 HTTP/1.1" 200 None
2026-03-28 07:36:33 [auto1.de] INFO: Scrape type for MW52698: 0
2026-03-28 07:36:33 [auto1.de] INFO: Found listing with ID: XK62781
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK62781%27 HTTP/1.1" 200 None
2026-03-28 07:36:33 [auto1.de] INFO: Scrape type for XK62781: 0
2026-03-28 07:36:33 [auto1.de] INFO: Found listing with ID: EX50371
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX50371%27 HTTP/1.1" 200 None
2026-03-28 07:36:33 [auto1.de] INFO: Scrape type for EX50371: 0
2026-03-28 07:36:33 [auto1.de] INFO: Found listing with ID: SM53889
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM53889%27 HTTP/1.1" 200 None
2026-03-28 07:36:33 [auto1.de] INFO: Scrape type for SM53889: 0
2026-03-28 07:36:33 [auto1.de] INFO: Found listing with ID: ZJ15384
2026-03-28 07:36:33 [auto1.de] INFO: Found listing with ID: EJ51089
2026-03-28 07:36:33 [auto1.de] INFO: Found listing with ID: RH43725
2026-03-28 07:36:33 [auto1.de] INFO: Found listing with ID: HL37424
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL37424%27 HTTP/1.1" 200 None
2026-03-28 07:36:33 [auto1.de] INFO: Scrape type for HL37424: 2
2026-03-28 07:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f985cc1-95b7-5e14-a395-1699dee538f8 with identifier: HL37424
2026-03-28 07:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f985cc1-95b7-5e14-a395-1699dee538f8 with scrape type 2
2026-03-28 07:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f985cc1-95b7-5e14-a395-1699dee538f8 with scrape type 2
2026-03-28 07:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f985cc1-95b7-5e14-a395-1699dee538f8, identifier: HL37424
2026-03-28 07:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f985cc1-95b7-5e14-a395-1699dee538f8 with identifier: HL37424
2026-03-28 07:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f985cc1-95b7-5e14-a395-1699dee538f8 with identifier: HL37424
2026-03-28 07:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f985cc1-95b7-5e14-a395-1699dee538f8 with identifier: HL37424 to the API
2026-03-28 07:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:53:27Z',
'fuel_type': 'diesel',
'id': '1f985cc1-95b7-5e14-a395-1699dee538f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL37424',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 95085,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-07-04',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2006}
2026-03-28 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL37424%27 HTTP/1.1" 200 None
2026-03-28 07:36:35 [auto1.de] INFO: Saving data for HL37424: {'auction_closing_time': 1774716807.0, 'created_time': 1774503055.386406, 'last_price_update_time': 1774683395.232114}
2026-03-28 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL37424') HTTP/1.1" 204 0
2026-03-28 07:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:36:35 [auto1.de] INFO: Channel: 24h | Page: 73 | totalHits: 9256 | hits on page: 40
2026-03-28 07:36:35 [auto1.de] INFO: Found listing with ID: AU06034
2026-03-28 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU06034%27 HTTP/1.1" 200 None
2026-03-28 07:36:35 [auto1.de] INFO: Scrape type for AU06034: 0
2026-03-28 07:36:35 [auto1.de] INFO: Found listing with ID: WS77403
2026-03-28 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS77403%27 HTTP/1.1" 200 None
2026-03-28 07:36:35 [auto1.de] INFO: Scrape type for WS77403: 0
2026-03-28 07:36:35 [auto1.de] INFO: Found listing with ID: TK41211
2026-03-28 07:36:35 [auto1.de] INFO: Found listing with ID: ZY94421
2026-03-28 07:36:35 [auto1.de] INFO: Found listing with ID: WC75235
2026-03-28 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC75235%27 HTTP/1.1" 200 None
2026-03-28 07:36:35 [auto1.de] INFO: Scrape type for WC75235: 2
2026-03-28 07:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2da5d001-b39f-5048-8bda-f4383c794893 with identifier: WC75235
2026-03-28 07:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2da5d001-b39f-5048-8bda-f4383c794893 with scrape type 2
2026-03-28 07:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2da5d001-b39f-5048-8bda-f4383c794893 with scrape type 2
2026-03-28 07:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2da5d001-b39f-5048-8bda-f4383c794893, identifier: WC75235
2026-03-28 07:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2da5d001-b39f-5048-8bda-f4383c794893 with identifier: WC75235
2026-03-28 07:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2da5d001-b39f-5048-8bda-f4383c794893 with identifier: WC75235
2026-03-28 07:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2da5d001-b39f-5048-8bda-f4383c794893 with identifier: WC75235 to the API
2026-03-28 07:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:55:48Z',
'fuel_type': 'diesel',
'id': '2da5d001-b39f-5048-8bda-f4383c794893',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC75235',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 280100,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-14',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2013}
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC75235%27 HTTP/1.1" 200 None
2026-03-28 07:36:36 [auto1.de] INFO: Saving data for WC75235: {'auction_closing_time': 1774716948.0, 'created_time': 1774465824.572477, 'last_price_update_time': 1774683396.02629}
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC75235') HTTP/1.1" 204 0
2026-03-28 07:36:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: DA54133
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA54133%27 HTTP/1.1" 200 None
2026-03-28 07:36:36 [auto1.de] INFO: Scrape type for DA54133: 0
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: KX50860
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX50860%27 HTTP/1.1" 200 None
2026-03-28 07:36:36 [auto1.de] INFO: Scrape type for KX50860: 0
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: YF68653
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF68653%27 HTTP/1.1" 200 None
2026-03-28 07:36:36 [auto1.de] INFO: Scrape type for YF68653: 0
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: EH94118
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: PV02416
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: RG17194
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG17194%27 HTTP/1.1" 200 None
2026-03-28 07:36:36 [auto1.de] INFO: Scrape type for RG17194: 0
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: UV04779
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV04779%27 HTTP/1.1" 200 None
2026-03-28 07:36:36 [auto1.de] INFO: Scrape type for UV04779: 0
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: XR73410
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR73410%27 HTTP/1.1" 200 None
2026-03-28 07:36:36 [auto1.de] INFO: Scrape type for XR73410: 0
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: ZL07849
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL07849%27 HTTP/1.1" 200 None
2026-03-28 07:36:36 [auto1.de] INFO: Scrape type for ZL07849: 0
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: WD56073
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD56073%27 HTTP/1.1" 200 None
2026-03-28 07:36:36 [auto1.de] INFO: Scrape type for WD56073: 0
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: MS74297
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: AR72060
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: AF40281
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: YM05661
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: YD12579
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD12579%27 HTTP/1.1" 200 None
2026-03-28 07:36:36 [auto1.de] INFO: Scrape type for YD12579: 0
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: HK56220
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK56220%27 HTTP/1.1" 200 None
2026-03-28 07:36:36 [auto1.de] INFO: Scrape type for HK56220: 2
2026-03-28 07:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f662416-b8fb-5cc6-aa9f-672bf21e302c with identifier: HK56220
2026-03-28 07:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f662416-b8fb-5cc6-aa9f-672bf21e302c with scrape type 2
2026-03-28 07:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f662416-b8fb-5cc6-aa9f-672bf21e302c with scrape type 2
2026-03-28 07:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f662416-b8fb-5cc6-aa9f-672bf21e302c, identifier: HK56220
2026-03-28 07:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f662416-b8fb-5cc6-aa9f-672bf21e302c with identifier: HK56220
2026-03-28 07:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f662416-b8fb-5cc6-aa9f-672bf21e302c with identifier: HK56220
2026-03-28 07:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f662416-b8fb-5cc6-aa9f-672bf21e302c with identifier: HK56220 to the API
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:17:22Z',
'fuel_type': 'petrol',
'id': '1f662416-b8fb-5cc6-aa9f-672bf21e302c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK56220',
'listing': 'auction',
'make': 'Ford',
'model': 'StreetKa',
'odometer': 144166,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-12-15',
'seller_name': None,
'title': 'Ford StreetKa 1.6 Elegance Roadster',
'transmission': 'manual',
'trim': 'Elegance Roadster',
'year': 2004}
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK56220%27 HTTP/1.1" 200 None
2026-03-28 07:36:36 [auto1.de] INFO: Saving data for HK56220: {'auction_closing_time': 1774714642.0, 'created_time': 1774468032.078561, 'last_price_update_time': 1774683396.727556}
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK56220') HTTP/1.1" 204 0
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: XE60710
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: NC17523
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: UY88235
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: HL95475
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: XL96433
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL96433%27 HTTP/1.1" 200 None
2026-03-28 07:36:36 [auto1.de] INFO: Scrape type for XL96433: 0
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: ZN01973
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN01973%27 HTTP/1.1" 200 None
2026-03-28 07:36:36 [auto1.de] INFO: Scrape type for ZN01973: 0
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: NF12247
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: NC53350
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC53350%27 HTTP/1.1" 200 None
2026-03-28 07:36:36 [auto1.de] INFO: Scrape type for NC53350: 0
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: EJ12041
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ12041%27 HTTP/1.1" 200 None
2026-03-28 07:36:36 [auto1.de] INFO: Scrape type for EJ12041: 0
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: AN47371
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: CP02009
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP02009%27 HTTP/1.1" 200 None
2026-03-28 07:36:36 [auto1.de] INFO: Scrape type for CP02009: 0
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: BS00370
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS00370%27 HTTP/1.1" 200 None
2026-03-28 07:36:36 [auto1.de] INFO: Scrape type for BS00370: 0
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: DV01319
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: KL64193
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: SY11611
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: RK19274
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: SC06159
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: GL55365
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL55365%27 HTTP/1.1" 200 None
2026-03-28 07:36:36 [auto1.de] INFO: Scrape type for GL55365: 0
2026-03-28 07:36:36 [auto1.de] INFO: Found listing with ID: BH13413
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH13413%27 HTTP/1.1" 200 None
2026-03-28 07:36:36 [auto1.de] INFO: Scrape type for BH13413: 0
2026-03-28 07:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:36:38 [auto1.de] INFO: Channel: 24h | Page: 74 | totalHits: 9256 | hits on page: 40
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: FP74638
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: VT42792
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT42792%27 HTTP/1.1" 200 None
2026-03-28 07:36:38 [auto1.de] INFO: Scrape type for VT42792: 0
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: HY48738
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: ZH02957
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH02957%27 HTTP/1.1" 200 None
2026-03-28 07:36:38 [auto1.de] INFO: Scrape type for ZH02957: 0
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: GT84792
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT84792%27 HTTP/1.1" 200 None
2026-03-28 07:36:38 [auto1.de] INFO: Scrape type for GT84792: 0
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: HK91051
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: UP40831
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP40831%27 HTTP/1.1" 200 None
2026-03-28 07:36:38 [auto1.de] INFO: Scrape type for UP40831: 0
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: DS39411
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS39411%27 HTTP/1.1" 200 None
2026-03-28 07:36:38 [auto1.de] INFO: Scrape type for DS39411: 0
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: VS91117
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS91117%27 HTTP/1.1" 200 None
2026-03-28 07:36:38 [auto1.de] INFO: Scrape type for VS91117: 0
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: PB41592
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: CR26579
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: JE51939
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE51939%27 HTTP/1.1" 200 None
2026-03-28 07:36:38 [auto1.de] INFO: Scrape type for JE51939: 0
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: ZP65093
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP65093%27 HTTP/1.1" 200 None
2026-03-28 07:36:38 [auto1.de] INFO: Scrape type for ZP65093: 0
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: LR33805
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: TD14056
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD14056%27 HTTP/1.1" 200 None
2026-03-28 07:36:38 [auto1.de] INFO: Scrape type for TD14056: 2
2026-03-28 07:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d256cf0-6292-596b-b2ec-f16de0a4cd5c with identifier: TD14056
2026-03-28 07:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d256cf0-6292-596b-b2ec-f16de0a4cd5c with scrape type 2
2026-03-28 07:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d256cf0-6292-596b-b2ec-f16de0a4cd5c with scrape type 2
2026-03-28 07:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d256cf0-6292-596b-b2ec-f16de0a4cd5c, identifier: TD14056
2026-03-28 07:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d256cf0-6292-596b-b2ec-f16de0a4cd5c with identifier: TD14056
2026-03-28 07:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d256cf0-6292-596b-b2ec-f16de0a4cd5c with identifier: TD14056
2026-03-28 07:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d256cf0-6292-596b-b2ec-f16de0a4cd5c with identifier: TD14056 to the API
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:43:59Z',
'fuel_type': 'petrol',
'id': '2d256cf0-6292-596b-b2ec-f16de0a4cd5c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD14056',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 150508,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-16',
'seller_name': None,
'title': 'BMW 2er 220i M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2015}
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD14056%27 HTTP/1.1" 200 None
2026-03-28 07:36:38 [auto1.de] INFO: Saving data for TD14056: {'auction_closing_time': 1774716239.0, 'created_time': 1774468040.928707, 'last_price_update_time': 1774683398.703025}
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD14056') HTTP/1.1" 204 0
2026-03-28 07:36:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: RR62010
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR62010%27 HTTP/1.1" 200 None
2026-03-28 07:36:38 [auto1.de] INFO: Scrape type for RR62010: 0
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: HS70377
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: RD35105
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: HU97464
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU97464%27 HTTP/1.1" 200 None
2026-03-28 07:36:38 [auto1.de] INFO: Scrape type for HU97464: 0
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: VP80711
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: BP08791
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: VH72223
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: AG77275
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG77275%27 HTTP/1.1" 200 None
2026-03-28 07:36:38 [auto1.de] INFO: Scrape type for AG77275: 0
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: SB59394
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB59394%27 HTTP/1.1" 200 None
2026-03-28 07:36:38 [auto1.de] INFO: Scrape type for SB59394: 0
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: DY48174
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY48174%27 HTTP/1.1" 200 None
2026-03-28 07:36:38 [auto1.de] INFO: Scrape type for DY48174: 0
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: EU37880
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU37880%27 HTTP/1.1" 200 None
2026-03-28 07:36:38 [auto1.de] INFO: Scrape type for EU37880: 0
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: PA09921
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA09921%27 HTTP/1.1" 200 None
2026-03-28 07:36:38 [auto1.de] INFO: Scrape type for PA09921: 0
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: JT14864
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT14864%27 HTTP/1.1" 200 None
2026-03-28 07:36:38 [auto1.de] INFO: Scrape type for JT14864: 0
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: UY11294
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY11294%27 HTTP/1.1" 200 None
2026-03-28 07:36:38 [auto1.de] INFO: Scrape type for UY11294: 0
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: AB69673
2026-03-28 07:36:38 [auto1.de] INFO: Found listing with ID: HM40523
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM40523%27 HTTP/1.1" 200 None
2026-03-28 07:36:38 [auto1.de] INFO: Scrape type for HM40523: 2
2026-03-28 07:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8708928-cc8e-5c60-843d-3258205e69c0 with identifier: HM40523
2026-03-28 07:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8708928-cc8e-5c60-843d-3258205e69c0 with scrape type 2
2026-03-28 07:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8708928-cc8e-5c60-843d-3258205e69c0 with scrape type 2
2026-03-28 07:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8708928-cc8e-5c60-843d-3258205e69c0, identifier: HM40523
2026-03-28 07:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8708928-cc8e-5c60-843d-3258205e69c0 with identifier: HM40523
2026-03-28 07:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8708928-cc8e-5c60-843d-3258205e69c0 with identifier: HM40523
2026-03-28 07:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8708928-cc8e-5c60-843d-3258205e69c0 with identifier: HM40523 to the API
2026-03-28 07:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-28T16:29:07Z',
'fuel_type': 'diesel',
'id': 'a8708928-cc8e-5c60-843d-3258205e69c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM40523',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 147776,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-08-28',
'seller_name': None,
'title': 'BMW X5 3.0d',
'transmission': 'automatic',
'trim': '',
'year': 2005}
2026-03-28 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM40523%27 HTTP/1.1" 200 None
2026-03-28 07:36:39 [auto1.de] INFO: Saving data for HM40523: {'auction_closing_time': 1774715347.0, 'created_time': 1774464204.384186, 'last_price_update_time': 1774683399.444897}
2026-03-28 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM40523') HTTP/1.1" 204 0
2026-03-28 07:36:39 [auto1.de] INFO: Found listing with ID: YV51703
2026-03-28 07:36:39 [auto1.de] INFO: Found listing with ID: KA78171
2026-03-28 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA78171%27 HTTP/1.1" 200 None
2026-03-28 07:36:39 [auto1.de] INFO: Scrape type for KA78171: 0
2026-03-28 07:36:39 [auto1.de] INFO: Found listing with ID: AL04579
2026-03-28 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL04579%27 HTTP/1.1" 200 None
2026-03-28 07:36:39 [auto1.de] INFO: Scrape type for AL04579: 0
2026-03-28 07:36:39 [auto1.de] INFO: Found listing with ID: BT69542
2026-03-28 07:36:39 [auto1.de] INFO: Found listing with ID: VR66334
2026-03-28 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR66334%27 HTTP/1.1" 200 None
2026-03-28 07:36:39 [auto1.de] INFO: Scrape type for VR66334: 0
2026-03-28 07:36:39 [auto1.de] INFO: Found listing with ID: XS43563
2026-03-28 07:36:39 [auto1.de] INFO: Found listing with ID: YV26215
2026-03-28 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV26215%27 HTTP/1.1" 200 None
2026-03-28 07:36:39 [auto1.de] INFO: Scrape type for YV26215: 2
2026-03-28 07:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 242a719b-8200-5d72-b4df-cdcb9379f9ed with identifier: YV26215
2026-03-28 07:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 242a719b-8200-5d72-b4df-cdcb9379f9ed with scrape type 2
2026-03-28 07:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 242a719b-8200-5d72-b4df-cdcb9379f9ed with scrape type 2
2026-03-28 07:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 242a719b-8200-5d72-b4df-cdcb9379f9ed, identifier: YV26215
2026-03-28 07:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 242a719b-8200-5d72-b4df-cdcb9379f9ed with identifier: YV26215
2026-03-28 07:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 242a719b-8200-5d72-b4df-cdcb9379f9ed with identifier: YV26215
2026-03-28 07:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 242a719b-8200-5d72-b4df-cdcb9379f9ed with identifier: YV26215 to the API
2026-03-28 07:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:57:10Z',
'fuel_type': 'diesel',
'id': '242a719b-8200-5d72-b4df-cdcb9379f9ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV26215',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 270436,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-18',
'seller_name': None,
'title': 'Volkswagen Golf V 1.9 TDI Sportline BlueMotion',
'transmission': 'manual',
'trim': 'Sportline BlueMotion',
'year': 2009}
2026-03-28 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV26215%27 HTTP/1.1" 200 None
2026-03-28 07:36:41 [auto1.de] INFO: Saving data for YV26215: {'auction_closing_time': 1774717030.0, 'created_time': 1774466590.128376, 'last_price_update_time': 1774683401.284066}
2026-03-28 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV26215') HTTP/1.1" 204 0
2026-03-28 07:36:41 [auto1.de] INFO: Found listing with ID: AX44497
2026-03-28 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX44497%27 HTTP/1.1" 200 None
2026-03-28 07:36:41 [auto1.de] INFO: Scrape type for AX44497: 0
2026-03-28 07:36:41 [auto1.de] INFO: Found listing with ID: JT36836
2026-03-28 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT36836%27 HTTP/1.1" 200 None
2026-03-28 07:36:41 [auto1.de] INFO: Scrape type for JT36836: 0
2026-03-28 07:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:36:42 [auto1.de] INFO: Channel: 24h | Page: 75 | totalHits: 9256 | hits on page: 40
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: PG58570
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: SS40295
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS40295%27 HTTP/1.1" 200 None
2026-03-28 07:36:42 [auto1.de] INFO: Scrape type for SS40295: 0
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: DS42443
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: SD15170
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: MD27320
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: TF08287
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF08287%27 HTTP/1.1" 200 None
2026-03-28 07:36:42 [auto1.de] INFO: Scrape type for TF08287: 0
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: LR15690
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: GE10245
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: WX73478
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX73478%27 HTTP/1.1" 200 None
2026-03-28 07:36:42 [auto1.de] INFO: Scrape type for WX73478: 0
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: PW24553
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: JC94959
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC94959%27 HTTP/1.1" 200 None
2026-03-28 07:36:42 [auto1.de] INFO: Scrape type for JC94959: 0
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: YT48506
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT48506%27 HTTP/1.1" 200 None
2026-03-28 07:36:42 [auto1.de] INFO: Scrape type for YT48506: 0
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: TL31198
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: ST88871
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: SW30333
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: WP44552
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP44552%27 HTTP/1.1" 200 None
2026-03-28 07:36:42 [auto1.de] INFO: Scrape type for WP44552: 0
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: KL19137
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL19137%27 HTTP/1.1" 200 None
2026-03-28 07:36:42 [auto1.de] INFO: Scrape type for KL19137: 0
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: LK69228
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK69228%27 HTTP/1.1" 200 None
2026-03-28 07:36:42 [auto1.de] INFO: Scrape type for LK69228: 0
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: LW42175
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW42175%27 HTTP/1.1" 200 None
2026-03-28 07:36:42 [auto1.de] INFO: Scrape type for LW42175: 0
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: WL05450
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: BD16858
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD16858%27 HTTP/1.1" 200 None
2026-03-28 07:36:42 [auto1.de] INFO: Scrape type for BD16858: 0
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: KA31515
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA31515%27 HTTP/1.1" 200 None
2026-03-28 07:36:42 [auto1.de] INFO: Scrape type for KA31515: 0
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: JP52122
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP52122%27 HTTP/1.1" 200 None
2026-03-28 07:36:42 [auto1.de] INFO: Scrape type for JP52122: 2
2026-03-28 07:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 856afd6b-74b7-582b-bd73-7889e649924d with identifier: JP52122
2026-03-28 07:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 856afd6b-74b7-582b-bd73-7889e649924d with scrape type 2
2026-03-28 07:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 856afd6b-74b7-582b-bd73-7889e649924d with scrape type 2
2026-03-28 07:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 856afd6b-74b7-582b-bd73-7889e649924d, identifier: JP52122
2026-03-28 07:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 856afd6b-74b7-582b-bd73-7889e649924d with identifier: JP52122
2026-03-28 07:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 856afd6b-74b7-582b-bd73-7889e649924d with identifier: JP52122
2026-03-28 07:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 856afd6b-74b7-582b-bd73-7889e649924d with identifier: JP52122 to the API
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:39:17Z',
'fuel_type': 'diesel',
'id': '856afd6b-74b7-582b-bd73-7889e649924d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP52122',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 103630,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-03',
'seller_name': None,
'title': 'Peugeot Expert 2.0 Blue-HDi Active L2',
'transmission': 'automatic',
'trim': 'Active L2',
'year': 2019}
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP52122%27 HTTP/1.1" 200 None
2026-03-28 07:36:42 [auto1.de] INFO: Saving data for JP52122: {'auction_closing_time': 1774715957.0, 'created_time': 1774466216.245713, 'last_price_update_time': 1774683402.856508}
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP52122') HTTP/1.1" 204 0
2026-03-28 07:36:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: BN76417
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN76417%27 HTTP/1.1" 200 None
2026-03-28 07:36:42 [auto1.de] INFO: Scrape type for BN76417: 0
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: BK52975
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: VU23200
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: KM26302
2026-03-28 07:36:42 [auto1.de] INFO: Found listing with ID: CB40051
2026-03-28 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB40051%27 HTTP/1.1" 200 None
2026-03-28 07:36:43 [auto1.de] INFO: Scrape type for CB40051: 0
2026-03-28 07:36:43 [auto1.de] INFO: Found listing with ID: WB94414
2026-03-28 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB94414%27 HTTP/1.1" 200 None
2026-03-28 07:36:43 [auto1.de] INFO: Scrape type for WB94414: 0
2026-03-28 07:36:43 [auto1.de] INFO: Found listing with ID: GB35925
2026-03-28 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB35925%27 HTTP/1.1" 200 None
2026-03-28 07:36:43 [auto1.de] INFO: Scrape type for GB35925: 2
2026-03-28 07:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e5f095c-bc72-528e-bcab-36d7f6097b8f with identifier: GB35925
2026-03-28 07:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e5f095c-bc72-528e-bcab-36d7f6097b8f with scrape type 2
2026-03-28 07:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e5f095c-bc72-528e-bcab-36d7f6097b8f with scrape type 2
2026-03-28 07:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e5f095c-bc72-528e-bcab-36d7f6097b8f, identifier: GB35925
2026-03-28 07:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e5f095c-bc72-528e-bcab-36d7f6097b8f with identifier: GB35925
2026-03-28 07:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e5f095c-bc72-528e-bcab-36d7f6097b8f with identifier: GB35925
2026-03-28 07:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e5f095c-bc72-528e-bcab-36d7f6097b8f with identifier: GB35925 to the API
2026-03-28 07:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:15:12Z',
'fuel_type': 'petrol',
'id': '0e5f095c-bc72-528e-bcab-36d7f6097b8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB35925',
'listing': 'auction',
'make': 'Nissan',
'model': 'Juke',
'odometer': 77428,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-22',
'seller_name': None,
'title': 'Nissan Juke 1.6 Tekna 4x4',
'transmission': 'automatic',
'trim': 'Tekna 4x4',
'year': 2015}
2026-03-28 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB35925%27 HTTP/1.1" 200 None
2026-03-28 07:36:43 [auto1.de] INFO: Saving data for GB35925: {'auction_closing_time': 1774714512.0, 'created_time': 1774464381.975776, 'last_price_update_time': 1774683403.486426}
2026-03-28 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB35925') HTTP/1.1" 204 0
2026-03-28 07:36:43 [auto1.de] INFO: Found listing with ID: BY57485
2026-03-28 07:36:43 [auto1.de] INFO: Found listing with ID: GR15178
2026-03-28 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR15178%27 HTTP/1.1" 200 None
2026-03-28 07:36:43 [auto1.de] INFO: Scrape type for GR15178: 2
2026-03-28 07:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5d8949b-73b2-5f80-ba5e-e972a405dcc3 with identifier: GR15178
2026-03-28 07:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5d8949b-73b2-5f80-ba5e-e972a405dcc3 with scrape type 2
2026-03-28 07:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5d8949b-73b2-5f80-ba5e-e972a405dcc3 with scrape type 2
2026-03-28 07:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5d8949b-73b2-5f80-ba5e-e972a405dcc3, identifier: GR15178
2026-03-28 07:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5d8949b-73b2-5f80-ba5e-e972a405dcc3 with identifier: GR15178
2026-03-28 07:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5d8949b-73b2-5f80-ba5e-e972a405dcc3 with identifier: GR15178
2026-03-28 07:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5d8949b-73b2-5f80-ba5e-e972a405dcc3 with identifier: GR15178 to the API
2026-03-28 07:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-28T16:13:46Z',
'fuel_type': 'diesel',
'id': 'f5d8949b-73b2-5f80-ba5e-e972a405dcc3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR15178',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 48248,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-03-19',
'seller_name': None,
'title': 'Audi Q5 40 TDI Mild-Hybrid quattro advanced',
'transmission': 'automatic',
'trim': 'quattro advanced',
'year': 2024}
2026-03-28 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR15178%27 HTTP/1.1" 200 None
2026-03-28 07:36:43 [auto1.de] INFO: Saving data for GR15178: {'auction_closing_time': 1774714426.0, 'created_time': 1774466442.035352, 'last_price_update_time': 1774683403.963571}
2026-03-28 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR15178') HTTP/1.1" 204 0
2026-03-28 07:36:43 [auto1.de] INFO: Found listing with ID: GC08315
2026-03-28 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC08315%27 HTTP/1.1" 200 None
2026-03-28 07:36:43 [auto1.de] INFO: Scrape type for GC08315: 0
2026-03-28 07:36:43 [auto1.de] INFO: Found listing with ID: VY10701
2026-03-28 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY10701%27 HTTP/1.1" 200 None
2026-03-28 07:36:44 [auto1.de] INFO: Scrape type for VY10701: 0
2026-03-28 07:36:44 [auto1.de] INFO: Found listing with ID: HX50499
2026-03-28 07:36:44 [auto1.de] INFO: Found listing with ID: GV04450
2026-03-28 07:36:44 [auto1.de] INFO: Found listing with ID: YK97708
2026-03-28 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK97708%27 HTTP/1.1" 200 None
2026-03-28 07:36:44 [auto1.de] INFO: Scrape type for YK97708: 0
2026-03-28 07:36:44 [auto1.de] INFO: Found listing with ID: NC07497
2026-03-28 07:36:44 [auto1.de] INFO: Found listing with ID: CC99000
2026-03-28 07:36:44 [auto1.de] INFO: Found listing with ID: PM61322
2026-03-28 07:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:36:44 [auto1.de] INFO: Channel: 24h | Page: 76 | totalHits: 9256 | hits on page: 40
2026-03-28 07:36:44 [auto1.de] INFO: Found listing with ID: FD42571
2026-03-28 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD42571%27 HTTP/1.1" 200 None
2026-03-28 07:36:44 [auto1.de] INFO: Scrape type for FD42571: 0
2026-03-28 07:36:44 [auto1.de] INFO: Found listing with ID: MN48285
2026-03-28 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN48285%27 HTTP/1.1" 200 None
2026-03-28 07:36:44 [auto1.de] INFO: Scrape type for MN48285: 0
2026-03-28 07:36:44 [auto1.de] INFO: Found listing with ID: NZ56847
2026-03-28 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ56847%27 HTTP/1.1" 200 None
2026-03-28 07:36:44 [auto1.de] INFO: Scrape type for NZ56847: 0
2026-03-28 07:36:44 [auto1.de] INFO: Found listing with ID: GJ53227
2026-03-28 07:36:44 [auto1.de] INFO: Found listing with ID: XM87462
2026-03-28 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM87462%27 HTTP/1.1" 200 None
2026-03-28 07:36:44 [auto1.de] INFO: Scrape type for XM87462: 0
2026-03-28 07:36:44 [auto1.de] INFO: Found listing with ID: HS15462
2026-03-28 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS15462%27 HTTP/1.1" 200 None
2026-03-28 07:36:44 [auto1.de] INFO: Scrape type for HS15462: 0
2026-03-28 07:36:44 [auto1.de] INFO: Found listing with ID: YH76604
2026-03-28 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH76604%27 HTTP/1.1" 200 None
2026-03-28 07:36:44 [auto1.de] INFO: Scrape type for YH76604: 0
2026-03-28 07:36:44 [auto1.de] INFO: Found listing with ID: GP04405
2026-03-28 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP04405%27 HTTP/1.1" 200 None
2026-03-28 07:36:45 [auto1.de] INFO: Scrape type for GP04405: 2
2026-03-28 07:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e444ff81-6908-58c1-83e2-dc2be469d110 with identifier: GP04405
2026-03-28 07:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e444ff81-6908-58c1-83e2-dc2be469d110 with scrape type 2
2026-03-28 07:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e444ff81-6908-58c1-83e2-dc2be469d110 with scrape type 2
2026-03-28 07:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e444ff81-6908-58c1-83e2-dc2be469d110, identifier: GP04405
2026-03-28 07:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e444ff81-6908-58c1-83e2-dc2be469d110 with identifier: GP04405
2026-03-28 07:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e444ff81-6908-58c1-83e2-dc2be469d110 with identifier: GP04405
2026-03-28 07:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e444ff81-6908-58c1-83e2-dc2be469d110 with identifier: GP04405 to the API
2026-03-28 07:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:07:51Z',
'fuel_type': 'petrol',
'id': 'e444ff81-6908-58c1-83e2-dc2be469d110',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP04405',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 129457,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-06-27',
'seller_name': None,
'title': 'Seat Ibiza 1.4 Fresh',
'transmission': 'manual',
'trim': 'Fresh',
'year': 2004}
2026-03-28 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP04405%27 HTTP/1.1" 200 None
2026-03-28 07:36:45 [auto1.de] INFO: Saving data for GP04405: {'auction_closing_time': 1774714071.0, 'created_time': 1774467938.931791, 'last_price_update_time': 1774683405.457196}
2026-03-28 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GP04405') HTTP/1.1" 204 0
2026-03-28 07:36:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:36:45 [auto1.de] INFO: Found listing with ID: FU27618
2026-03-28 07:36:45 [auto1.de] INFO: Found listing with ID: MS18045
2026-03-28 07:36:45 [auto1.de] INFO: Found listing with ID: NJ21212
2026-03-28 07:36:45 [auto1.de] INFO: Found listing with ID: FL30108
2026-03-28 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL30108%27 HTTP/1.1" 200 None
2026-03-28 07:36:45 [auto1.de] INFO: Scrape type for FL30108: 0
2026-03-28 07:36:45 [auto1.de] INFO: Found listing with ID: KY92219
2026-03-28 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY92219%27 HTTP/1.1" 200 None
2026-03-28 07:36:45 [auto1.de] INFO: Scrape type for KY92219: 0
2026-03-28 07:36:45 [auto1.de] INFO: Found listing with ID: WA59870
2026-03-28 07:36:45 [auto1.de] INFO: Found listing with ID: HZ51579
2026-03-28 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ51579%27 HTTP/1.1" 200 None
2026-03-28 07:36:45 [auto1.de] INFO: Scrape type for HZ51579: 0
2026-03-28 07:36:45 [auto1.de] INFO: Found listing with ID: PP05974
2026-03-28 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP05974%27 HTTP/1.1" 200 None
2026-03-28 07:36:45 [auto1.de] INFO: Scrape type for PP05974: 2
2026-03-28 07:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 098f4e87-7d35-52de-a10b-f0117fce46a8 with identifier: PP05974
2026-03-28 07:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 098f4e87-7d35-52de-a10b-f0117fce46a8 with scrape type 2
2026-03-28 07:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 098f4e87-7d35-52de-a10b-f0117fce46a8 with scrape type 2
2026-03-28 07:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 098f4e87-7d35-52de-a10b-f0117fce46a8, identifier: PP05974
2026-03-28 07:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 098f4e87-7d35-52de-a10b-f0117fce46a8 with identifier: PP05974
2026-03-28 07:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 098f4e87-7d35-52de-a10b-f0117fce46a8 with identifier: PP05974
2026-03-28 07:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 098f4e87-7d35-52de-a10b-f0117fce46a8 with identifier: PP05974 to the API
2026-03-28 07:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:32:11Z',
'fuel_type': 'diesel',
'id': '098f4e87-7d35-52de-a10b-f0117fce46a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP05974',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 220697,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-13',
'seller_name': None,
'title': 'Audi A6 2.0 TDI Ultra',
'transmission': 'automatic',
'trim': 'Ultra',
'year': 2015}
2026-03-28 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP05974%27 HTTP/1.1" 200 None
2026-03-28 07:36:46 [auto1.de] INFO: Saving data for PP05974: {'auction_closing_time': 1774715531.0, 'created_time': 1774467192.721434, 'last_price_update_time': 1774683406.0394}
2026-03-28 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP05974') HTTP/1.1" 204 0
2026-03-28 07:36:46 [auto1.de] INFO: Found listing with ID: YL90349
2026-03-28 07:36:46 [auto1.de] INFO: Found listing with ID: SG28912
2026-03-28 07:36:46 [auto1.de] INFO: Found listing with ID: WL74765
2026-03-28 07:36:46 [auto1.de] INFO: Found listing with ID: RC95645
2026-03-28 07:36:46 [auto1.de] INFO: Found listing with ID: NG76002
2026-03-28 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG76002%27 HTTP/1.1" 200 None
2026-03-28 07:36:46 [auto1.de] INFO: Scrape type for NG76002: 0
2026-03-28 07:36:46 [auto1.de] INFO: Found listing with ID: RE35722
2026-03-28 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE35722%27 HTTP/1.1" 200 None
2026-03-28 07:36:46 [auto1.de] INFO: Scrape type for RE35722: 0
2026-03-28 07:36:46 [auto1.de] INFO: Found listing with ID: YL65079
2026-03-28 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL65079%27 HTTP/1.1" 200 None
2026-03-28 07:36:46 [auto1.de] INFO: Scrape type for YL65079: 0
2026-03-28 07:36:46 [auto1.de] INFO: Found listing with ID: TG47191
2026-03-28 07:36:46 [auto1.de] INFO: Found listing with ID: WA93069
2026-03-28 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA93069%27 HTTP/1.1" 200 None
2026-03-28 07:36:46 [auto1.de] INFO: Scrape type for WA93069: 0
2026-03-28 07:36:46 [auto1.de] INFO: Found listing with ID: CV90861
2026-03-28 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV90861%27 HTTP/1.1" 200 None
2026-03-28 07:36:46 [auto1.de] INFO: Scrape type for CV90861: 0
2026-03-28 07:36:46 [auto1.de] INFO: Found listing with ID: MS18756
2026-03-28 07:36:46 [auto1.de] INFO: Found listing with ID: VG72700
2026-03-28 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG72700%27 HTTP/1.1" 200 None
2026-03-28 07:36:46 [auto1.de] INFO: Scrape type for VG72700: 0
2026-03-28 07:36:46 [auto1.de] INFO: Found listing with ID: XJ79433
2026-03-28 07:36:46 [auto1.de] INFO: Found listing with ID: KR27506
2026-03-28 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR27506%27 HTTP/1.1" 200 None
2026-03-28 07:36:46 [auto1.de] INFO: Scrape type for KR27506: 0
2026-03-28 07:36:46 [auto1.de] INFO: Found listing with ID: BB52240
2026-03-28 07:36:46 [auto1.de] INFO: Found listing with ID: NK01451
2026-03-28 07:36:46 [auto1.de] INFO: Found listing with ID: JR94106
2026-03-28 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR94106%27 HTTP/1.1" 200 None
2026-03-28 07:36:46 [auto1.de] INFO: Scrape type for JR94106: 0
2026-03-28 07:36:46 [auto1.de] INFO: Found listing with ID: HU72855
2026-03-28 07:36:46 [auto1.de] INFO: Found listing with ID: SZ55877
2026-03-28 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ55877%27 HTTP/1.1" 200 None
2026-03-28 07:36:46 [auto1.de] INFO: Scrape type for SZ55877: 0
2026-03-28 07:36:46 [auto1.de] INFO: Found listing with ID: HT34266
2026-03-28 07:36:46 [auto1.de] INFO: Found listing with ID: ZS42490
2026-03-28 07:36:46 [auto1.de] INFO: Found listing with ID: DP85983
2026-03-28 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP85983%27 HTTP/1.1" 200 None
2026-03-28 07:36:46 [auto1.de] INFO: Scrape type for DP85983: 0
2026-03-28 07:36:46 [auto1.de] INFO: Found listing with ID: SC11687
2026-03-28 07:36:46 [auto1.de] INFO: Found listing with ID: XY56978
2026-03-28 07:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:36:47 [auto1.de] INFO: Channel: 24h | Page: 77 | totalHits: 9256 | hits on page: 40
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: GK61319
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: DV16657
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV16657%27 HTTP/1.1" 200 None
2026-03-28 07:36:47 [auto1.de] INFO: Scrape type for DV16657: 2
2026-03-28 07:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07990359-9885-5672-9237-49cf64eacc7c with identifier: DV16657
2026-03-28 07:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07990359-9885-5672-9237-49cf64eacc7c with scrape type 2
2026-03-28 07:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07990359-9885-5672-9237-49cf64eacc7c with scrape type 2
2026-03-28 07:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07990359-9885-5672-9237-49cf64eacc7c, identifier: DV16657
2026-03-28 07:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07990359-9885-5672-9237-49cf64eacc7c with identifier: DV16657
2026-03-28 07:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07990359-9885-5672-9237-49cf64eacc7c with identifier: DV16657
2026-03-28 07:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07990359-9885-5672-9237-49cf64eacc7c with identifier: DV16657 to the API
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:10:13Z',
'fuel_type': 'petrol',
'id': '07990359-9885-5672-9237-49cf64eacc7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV16657',
'listing': 'auction',
'make': 'Seat',
'model': 'Ateca',
'odometer': 56921,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-23',
'seller_name': None,
'title': 'Seat Ateca 1.5 TSI ACT FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2021}
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV16657%27 HTTP/1.1" 200 None
2026-03-28 07:36:47 [auto1.de] INFO: Saving data for DV16657: {'auction_closing_time': 1774714213.0, 'created_time': 1774466662.47617, 'last_price_update_time': 1774683407.693038}
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV16657') HTTP/1.1" 204 0
2026-03-28 07:36:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: JM68743
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: RP89370
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP89370%27 HTTP/1.1" 200 None
2026-03-28 07:36:47 [auto1.de] INFO: Scrape type for RP89370: 0
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: KT67254
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT67254%27 HTTP/1.1" 200 None
2026-03-28 07:36:47 [auto1.de] INFO: Scrape type for KT67254: 0
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: KX34445
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: YD08284
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: TR81218
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: RS40797
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: MU50288
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: HJ77178
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: BH21613
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: CN04574
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN04574%27 HTTP/1.1" 200 None
2026-03-28 07:36:47 [auto1.de] INFO: Scrape type for CN04574: 0
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: GT95785
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT95785%27 HTTP/1.1" 200 None
2026-03-28 07:36:47 [auto1.de] INFO: Scrape type for GT95785: 0
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: ME08770
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME08770%27 HTTP/1.1" 200 None
2026-03-28 07:36:47 [auto1.de] INFO: Scrape type for ME08770: 0
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: JZ46683
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: WT07379
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: BU09322
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU09322%27 HTTP/1.1" 200 None
2026-03-28 07:36:47 [auto1.de] INFO: Scrape type for BU09322: 0
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: YS02767
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS02767%27 HTTP/1.1" 200 None
2026-03-28 07:36:47 [auto1.de] INFO: Scrape type for YS02767: 0
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: HZ43600
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: PX80115
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: SA01659
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA01659%27 HTTP/1.1" 200 None
2026-03-28 07:36:47 [auto1.de] INFO: Scrape type for SA01659: 0
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: ZE36621
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: TY52919
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY52919%27 HTTP/1.1" 200 None
2026-03-28 07:36:47 [auto1.de] INFO: Scrape type for TY52919: 0
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: DE35783
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE35783%27 HTTP/1.1" 200 None
2026-03-28 07:36:47 [auto1.de] INFO: Scrape type for DE35783: 0
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: UR98494
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: RU06451
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU06451%27 HTTP/1.1" 200 None
2026-03-28 07:36:47 [auto1.de] INFO: Scrape type for RU06451: 0
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: YY05460
2026-03-28 07:36:47 [auto1.de] INFO: Found listing with ID: YH78241
2026-03-28 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH78241%27 HTTP/1.1" 200 None
2026-03-28 07:36:48 [auto1.de] INFO: Scrape type for YH78241: 0
2026-03-28 07:36:48 [auto1.de] INFO: Found listing with ID: FB23073
2026-03-28 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB23073%27 HTTP/1.1" 200 None
2026-03-28 07:36:48 [auto1.de] INFO: Scrape type for FB23073: 0
2026-03-28 07:36:48 [auto1.de] INFO: Found listing with ID: WL45042
2026-03-28 07:36:48 [auto1.de] INFO: Found listing with ID: AA98436
2026-03-28 07:36:48 [auto1.de] INFO: Found listing with ID: CZ24918
2026-03-28 07:36:48 [auto1.de] INFO: Found listing with ID: YR22562
2026-03-28 07:36:48 [auto1.de] INFO: Found listing with ID: GR85769
2026-03-28 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR85769%27 HTTP/1.1" 200 None
2026-03-28 07:36:48 [auto1.de] INFO: Scrape type for GR85769: 0
2026-03-28 07:36:48 [auto1.de] INFO: Found listing with ID: YF58476
2026-03-28 07:36:48 [auto1.de] INFO: Found listing with ID: FT39707
2026-03-28 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT39707%27 HTTP/1.1" 200 None
2026-03-28 07:36:48 [auto1.de] INFO: Scrape type for FT39707: 0
2026-03-28 07:36:48 [auto1.de] INFO: Found listing with ID: EL87499
2026-03-28 07:36:48 [auto1.de] INFO: Found listing with ID: GG27070
2026-03-28 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG27070%27 HTTP/1.1" 200 None
2026-03-28 07:36:48 [auto1.de] INFO: Scrape type for GG27070: 0
2026-03-28 07:36:48 [auto1.de] INFO: Found listing with ID: ZG88444
2026-03-28 07:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:36:49 [auto1.de] INFO: Channel: 24h | Page: 78 | totalHits: 9256 | hits on page: 40
2026-03-28 07:36:49 [auto1.de] INFO: Found listing with ID: EL37075
2026-03-28 07:36:49 [auto1.de] INFO: Found listing with ID: JB75617
2026-03-28 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB75617%27 HTTP/1.1" 200 None
2026-03-28 07:36:49 [auto1.de] INFO: Scrape type for JB75617: 0
2026-03-28 07:36:49 [auto1.de] INFO: Found listing with ID: AX08023
2026-03-28 07:36:49 [auto1.de] INFO: Found listing with ID: GL08454
2026-03-28 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL08454%27 HTTP/1.1" 200 None
2026-03-28 07:36:49 [auto1.de] INFO: Scrape type for GL08454: 2
2026-03-28 07:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e8fe8f8-f8b0-51f8-9f9a-6cf41cb4153a with identifier: GL08454
2026-03-28 07:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e8fe8f8-f8b0-51f8-9f9a-6cf41cb4153a with scrape type 2
2026-03-28 07:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e8fe8f8-f8b0-51f8-9f9a-6cf41cb4153a with scrape type 2
2026-03-28 07:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e8fe8f8-f8b0-51f8-9f9a-6cf41cb4153a, identifier: GL08454
2026-03-28 07:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e8fe8f8-f8b0-51f8-9f9a-6cf41cb4153a with identifier: GL08454
2026-03-28 07:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e8fe8f8-f8b0-51f8-9f9a-6cf41cb4153a with identifier: GL08454
2026-03-28 07:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e8fe8f8-f8b0-51f8-9f9a-6cf41cb4153a with identifier: GL08454 to the API
2026-03-28 07:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:01:07Z',
'fuel_type': 'diesel',
'id': '5e8fe8f8-f8b0-51f8-9f9a-6cf41cb4153a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL08454',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 241657,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-18',
'seller_name': None,
'title': 'Seat Leon 2.0 TDI FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2015}
2026-03-28 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL08454%27 HTTP/1.1" 200 None
2026-03-28 07:36:49 [auto1.de] INFO: Saving data for GL08454: {'auction_closing_time': 1774713667.0, 'created_time': 1774466954.086349, 'last_price_update_time': 1774683409.565339}
2026-03-28 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL08454') HTTP/1.1" 204 0
2026-03-28 07:36:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:36:49 [auto1.de] INFO: Found listing with ID: UW91893
2026-03-28 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW91893%27 HTTP/1.1" 200 None
2026-03-28 07:36:49 [auto1.de] INFO: Scrape type for UW91893: 0
2026-03-28 07:36:49 [auto1.de] INFO: Found listing with ID: VU06993
2026-03-28 07:36:49 [auto1.de] INFO: Found listing with ID: CJ78227
2026-03-28 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ78227%27 HTTP/1.1" 200 None
2026-03-28 07:36:49 [auto1.de] INFO: Scrape type for CJ78227: 0
2026-03-28 07:36:49 [auto1.de] INFO: Found listing with ID: CU13937
2026-03-28 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU13937%27 HTTP/1.1" 200 None
2026-03-28 07:36:49 [auto1.de] INFO: Scrape type for CU13937: 0
2026-03-28 07:36:49 [auto1.de] INFO: Found listing with ID: XW80989
2026-03-28 07:36:49 [auto1.de] INFO: Found listing with ID: EJ47615
2026-03-28 07:36:49 [auto1.de] INFO: Found listing with ID: DR71954
2026-03-28 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR71954%27 HTTP/1.1" 200 None
2026-03-28 07:36:49 [auto1.de] INFO: Scrape type for DR71954: 2
2026-03-28 07:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e40c36f9-074d-5041-9ff3-2b6d418aa1c0 with identifier: DR71954
2026-03-28 07:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e40c36f9-074d-5041-9ff3-2b6d418aa1c0 with scrape type 2
2026-03-28 07:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e40c36f9-074d-5041-9ff3-2b6d418aa1c0 with scrape type 2
2026-03-28 07:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e40c36f9-074d-5041-9ff3-2b6d418aa1c0, identifier: DR71954
2026-03-28 07:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e40c36f9-074d-5041-9ff3-2b6d418aa1c0 with identifier: DR71954
2026-03-28 07:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e40c36f9-074d-5041-9ff3-2b6d418aa1c0 with identifier: DR71954
2026-03-28 07:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e40c36f9-074d-5041-9ff3-2b6d418aa1c0 with identifier: DR71954 to the API
2026-03-28 07:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:42:36Z',
'fuel_type': 'petrol',
'id': 'e40c36f9-074d-5041-9ff3-2b6d418aa1c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR71954',
'listing': 'auction',
'make': 'Subaru',
'model': 'Forester',
'odometer': 56698,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-26',
'seller_name': None,
'title': 'Subaru Forester 2.0 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2017}
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR71954%27 HTTP/1.1" 200 None
2026-03-28 07:36:50 [auto1.de] INFO: Saving data for DR71954: {'auction_closing_time': 1774716156.0, 'created_time': 1773830015.412445, 'last_price_update_time': 1774683410.164309}
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR71954') HTTP/1.1" 204 0
2026-03-28 07:36:50 [auto1.de] INFO: Found listing with ID: SN40522
2026-03-28 07:36:50 [auto1.de] INFO: Found listing with ID: SY14600
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY14600%27 HTTP/1.1" 200 None
2026-03-28 07:36:50 [auto1.de] INFO: Scrape type for SY14600: 0
2026-03-28 07:36:50 [auto1.de] INFO: Found listing with ID: PH98737
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH98737%27 HTTP/1.1" 200 None
2026-03-28 07:36:50 [auto1.de] INFO: Scrape type for PH98737: 0
2026-03-28 07:36:50 [auto1.de] INFO: Found listing with ID: SF52194
2026-03-28 07:36:50 [auto1.de] INFO: Found listing with ID: VW86065
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW86065%27 HTTP/1.1" 200 None
2026-03-28 07:36:50 [auto1.de] INFO: Scrape type for VW86065: 0
2026-03-28 07:36:50 [auto1.de] INFO: Found listing with ID: VZ54866
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ54866%27 HTTP/1.1" 200 None
2026-03-28 07:36:50 [auto1.de] INFO: Scrape type for VZ54866: 0
2026-03-28 07:36:50 [auto1.de] INFO: Found listing with ID: LA56471
2026-03-28 07:36:50 [auto1.de] INFO: Found listing with ID: MK79183
2026-03-28 07:36:50 [auto1.de] INFO: Found listing with ID: TJ08431
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ08431%27 HTTP/1.1" 200 None
2026-03-28 07:36:50 [auto1.de] INFO: Scrape type for TJ08431: 0
2026-03-28 07:36:50 [auto1.de] INFO: Found listing with ID: BR43966
2026-03-28 07:36:50 [auto1.de] INFO: Found listing with ID: TL68554
2026-03-28 07:36:50 [auto1.de] INFO: Found listing with ID: NZ84353
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ84353%27 HTTP/1.1" 200 None
2026-03-28 07:36:50 [auto1.de] INFO: Scrape type for NZ84353: 0
2026-03-28 07:36:50 [auto1.de] INFO: Found listing with ID: ST39161
2026-03-28 07:36:50 [auto1.de] INFO: Found listing with ID: XY22197
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY22197%27 HTTP/1.1" 200 None
2026-03-28 07:36:50 [auto1.de] INFO: Scrape type for XY22197: 2
2026-03-28 07:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec2774c8-eff2-561d-a45f-ec913cec60e4 with identifier: XY22197
2026-03-28 07:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec2774c8-eff2-561d-a45f-ec913cec60e4 with scrape type 2
2026-03-28 07:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec2774c8-eff2-561d-a45f-ec913cec60e4 with scrape type 2
2026-03-28 07:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec2774c8-eff2-561d-a45f-ec913cec60e4, identifier: XY22197
2026-03-28 07:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec2774c8-eff2-561d-a45f-ec913cec60e4 with identifier: XY22197
2026-03-28 07:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec2774c8-eff2-561d-a45f-ec913cec60e4 with identifier: XY22197
2026-03-28 07:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec2774c8-eff2-561d-a45f-ec913cec60e4 with identifier: XY22197 to the API
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:19:59Z',
'fuel_type': 'diesel',
'id': 'ec2774c8-eff2-561d-a45f-ec913cec60e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY22197',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 132605,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-19',
'seller_name': None,
'title': 'Peugeot Expert 2.0 Blue-HDi Pro L1',
'transmission': 'manual',
'trim': 'Pro L1',
'year': 2018}
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY22197%27 HTTP/1.1" 200 None
2026-03-28 07:36:50 [auto1.de] INFO: Saving data for XY22197: {'auction_closing_time': 1774714799.0, 'created_time': 1774466693.72236, 'last_price_update_time': 1774683410.682826}
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY22197') HTTP/1.1" 204 0
2026-03-28 07:36:50 [auto1.de] INFO: Found listing with ID: WB34474
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB34474%27 HTTP/1.1" 200 None
2026-03-28 07:36:50 [auto1.de] INFO: Scrape type for WB34474: 0
2026-03-28 07:36:50 [auto1.de] INFO: Found listing with ID: EG77695
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG77695%27 HTTP/1.1" 200 None
2026-03-28 07:36:50 [auto1.de] INFO: Scrape type for EG77695: 0
2026-03-28 07:36:50 [auto1.de] INFO: Found listing with ID: TN32015
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN32015%27 HTTP/1.1" 200 None
2026-03-28 07:36:50 [auto1.de] INFO: Scrape type for TN32015: 0
2026-03-28 07:36:50 [auto1.de] INFO: Found listing with ID: LZ81605
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ81605%27 HTTP/1.1" 200 None
2026-03-28 07:36:50 [auto1.de] INFO: Scrape type for LZ81605: 2
2026-03-28 07:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e47d6a79-d7db-5c61-811c-d6f638c3e67a with identifier: LZ81605
2026-03-28 07:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e47d6a79-d7db-5c61-811c-d6f638c3e67a with scrape type 2
2026-03-28 07:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e47d6a79-d7db-5c61-811c-d6f638c3e67a with scrape type 2
2026-03-28 07:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e47d6a79-d7db-5c61-811c-d6f638c3e67a, identifier: LZ81605
2026-03-28 07:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e47d6a79-d7db-5c61-811c-d6f638c3e67a with identifier: LZ81605
2026-03-28 07:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e47d6a79-d7db-5c61-811c-d6f638c3e67a with identifier: LZ81605
2026-03-28 07:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e47d6a79-d7db-5c61-811c-d6f638c3e67a with identifier: LZ81605 to the API
2026-03-28 07:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:15:20Z',
'fuel_type': 'petrol',
'id': 'e47d6a79-d7db-5c61-811c-d6f638c3e67a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ81605',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 120084,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-21',
'seller_name': None,
'title': 'Audi A3 Sportback 1.0 TFSI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2017}
2026-03-28 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ81605%27 HTTP/1.1" 200 None
2026-03-28 07:36:51 [auto1.de] INFO: Saving data for LZ81605: {'auction_closing_time': 1774714520.0, 'created_time': 1774033146.395318, 'last_price_update_time': 1774683411.305003}
2026-03-28 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ81605') HTTP/1.1" 204 0
2026-03-28 07:36:51 [auto1.de] INFO: Found listing with ID: CJ47476
2026-03-28 07:36:51 [auto1.de] INFO: Found listing with ID: JA27410
2026-03-28 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA27410%27 HTTP/1.1" 200 None
2026-03-28 07:36:51 [auto1.de] INFO: Scrape type for JA27410: 0
2026-03-28 07:36:51 [auto1.de] INFO: Found listing with ID: MB08927
2026-03-28 07:36:51 [auto1.de] INFO: Found listing with ID: AG51690
2026-03-28 07:36:51 [auto1.de] INFO: Found listing with ID: PS52652
2026-03-28 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS52652%27 HTTP/1.1" 200 None
2026-03-28 07:36:51 [auto1.de] INFO: Scrape type for PS52652: 0
2026-03-28 07:36:51 [auto1.de] INFO: Found listing with ID: KS41473
2026-03-28 07:36:51 [auto1.de] INFO: Found listing with ID: YM31567
2026-03-28 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM31567%27 HTTP/1.1" 200 None
2026-03-28 07:36:51 [auto1.de] INFO: Scrape type for YM31567: 0
2026-03-28 07:36:51 [auto1.de] INFO: Found listing with ID: CV85765
2026-03-28 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV85765%27 HTTP/1.1" 200 None
2026-03-28 07:36:51 [auto1.de] INFO: Scrape type for CV85765: 0
2026-03-28 07:36:51 [auto1.de] INFO: Found listing with ID: AG29521
2026-03-28 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG29521%27 HTTP/1.1" 200 None
2026-03-28 07:36:51 [auto1.de] INFO: Scrape type for AG29521: 0
2026-03-28 07:36:51 [auto1.de] INFO: Found listing with ID: AC43250
2026-03-28 07:36:51 [auto1.de] INFO: Found listing with ID: YW50653
2026-03-28 07:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:36:52 [auto1.de] INFO: Channel: 24h | Page: 79 | totalHits: 9256 | hits on page: 40
2026-03-28 07:36:52 [auto1.de] INFO: Found listing with ID: LV55209
2026-03-28 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55209%27 HTTP/1.1" 200 None
2026-03-28 07:36:52 [auto1.de] INFO: Scrape type for LV55209: 0
2026-03-28 07:36:52 [auto1.de] INFO: Found listing with ID: PB72951
2026-03-28 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB72951%27 HTTP/1.1" 200 None
2026-03-28 07:36:52 [auto1.de] INFO: Scrape type for PB72951: 0
2026-03-28 07:36:52 [auto1.de] INFO: Found listing with ID: WM94615
2026-03-28 07:36:52 [auto1.de] INFO: Found listing with ID: LG52677
2026-03-28 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG52677%27 HTTP/1.1" 200 None
2026-03-28 07:36:52 [auto1.de] INFO: Scrape type for LG52677: 0
2026-03-28 07:36:52 [auto1.de] INFO: Found listing with ID: DB49845
2026-03-28 07:36:52 [auto1.de] INFO: Found listing with ID: FN07032
2026-03-28 07:36:52 [auto1.de] INFO: Found listing with ID: NZ83271
2026-03-28 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ83271%27 HTTP/1.1" 200 None
2026-03-28 07:36:52 [auto1.de] INFO: Scrape type for NZ83271: 0
2026-03-28 07:36:52 [auto1.de] INFO: Found listing with ID: UF26861
2026-03-28 07:36:52 [auto1.de] INFO: Found listing with ID: ET42367
2026-03-28 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET42367%27 HTTP/1.1" 200 None
2026-03-28 07:36:52 [auto1.de] INFO: Scrape type for ET42367: 2
2026-03-28 07:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81c074ef-e783-5f39-8e05-2812b866dd3c with identifier: ET42367
2026-03-28 07:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81c074ef-e783-5f39-8e05-2812b866dd3c with scrape type 2
2026-03-28 07:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81c074ef-e783-5f39-8e05-2812b866dd3c with scrape type 2
2026-03-28 07:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81c074ef-e783-5f39-8e05-2812b866dd3c, identifier: ET42367
2026-03-28 07:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81c074ef-e783-5f39-8e05-2812b866dd3c with identifier: ET42367
2026-03-28 07:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81c074ef-e783-5f39-8e05-2812b866dd3c with identifier: ET42367
2026-03-28 07:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81c074ef-e783-5f39-8e05-2812b866dd3c with identifier: ET42367 to the API
2026-03-28 07:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:40:05Z',
'fuel_type': 'petrol',
'id': '81c074ef-e783-5f39-8e05-2812b866dd3c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET42367',
'listing': 'auction',
'make': 'Renault',
'model': 'Wind',
'odometer': 128292,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-10-18',
'seller_name': None,
'title': 'Renault Wind 1.2 Night & Day',
'transmission': 'manual',
'trim': 'Night & Day',
'year': 2010}
2026-03-28 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET42367%27 HTTP/1.1" 200 None
2026-03-28 07:36:52 [auto1.de] INFO: Saving data for ET42367: {'auction_closing_time': 1774716005.0, 'created_time': 1774467694.821035, 'last_price_update_time': 1774683412.767784}
2026-03-28 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ET42367') HTTP/1.1" 204 0
2026-03-28 07:36:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:36:52 [auto1.de] INFO: Found listing with ID: WG43761
2026-03-28 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG43761%27 HTTP/1.1" 200 None
2026-03-28 07:36:52 [auto1.de] INFO: Scrape type for WG43761: 0
2026-03-28 07:36:52 [auto1.de] INFO: Found listing with ID: SG57857
2026-03-28 07:36:52 [auto1.de] INFO: Found listing with ID: XN13180
2026-03-28 07:36:52 [auto1.de] INFO: Found listing with ID: JW06785
2026-03-28 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW06785%27 HTTP/1.1" 200 None
2026-03-28 07:36:52 [auto1.de] INFO: Scrape type for JW06785: 0
2026-03-28 07:36:52 [auto1.de] INFO: Found listing with ID: LE51560
2026-03-28 07:36:52 [auto1.de] INFO: Found listing with ID: KH68440
2026-03-28 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH68440%27 HTTP/1.1" 200 None
2026-03-28 07:36:52 [auto1.de] INFO: Scrape type for KH68440: 2
2026-03-28 07:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e32eb1f-73ef-5f29-9585-014ce22eb1c6 with identifier: KH68440
2026-03-28 07:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e32eb1f-73ef-5f29-9585-014ce22eb1c6 with scrape type 2
2026-03-28 07:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e32eb1f-73ef-5f29-9585-014ce22eb1c6 with scrape type 2
2026-03-28 07:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e32eb1f-73ef-5f29-9585-014ce22eb1c6, identifier: KH68440
2026-03-28 07:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e32eb1f-73ef-5f29-9585-014ce22eb1c6 with identifier: KH68440
2026-03-28 07:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e32eb1f-73ef-5f29-9585-014ce22eb1c6 with identifier: KH68440
2026-03-28 07:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e32eb1f-73ef-5f29-9585-014ce22eb1c6 with identifier: KH68440 to the API
2026-03-28 07:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 333,
'expiration_date': '2026-03-28T16:41:39Z',
'fuel_type': 'petrol',
'id': '2e32eb1f-73ef-5f29-9585-014ce22eb1c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH68440',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 60391,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-17',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TSI R 20 Years 4Motion',
'transmission': 'automatic',
'trim': 'R 20 Years 4Motion',
'year': 2024}
2026-03-28 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH68440%27 HTTP/1.1" 200 None
2026-03-28 07:36:53 [auto1.de] INFO: Saving data for KH68440: {'auction_closing_time': 1774716099.0, 'created_time': 1774467462.311796, 'last_price_update_time': 1774683413.346524}
2026-03-28 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH68440') HTTP/1.1" 204 0
2026-03-28 07:36:53 [auto1.de] INFO: Found listing with ID: RA83567
2026-03-28 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA83567%27 HTTP/1.1" 200 None
2026-03-28 07:36:53 [auto1.de] INFO: Scrape type for RA83567: 0
2026-03-28 07:36:53 [auto1.de] INFO: Found listing with ID: BV43774
2026-03-28 07:36:53 [auto1.de] INFO: Found listing with ID: TE58420
2026-03-28 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE58420%27 HTTP/1.1" 200 None
2026-03-28 07:36:53 [auto1.de] INFO: Scrape type for TE58420: 0
2026-03-28 07:36:53 [auto1.de] INFO: Found listing with ID: XP05146
2026-03-28 07:36:53 [auto1.de] INFO: Found listing with ID: MP68485
2026-03-28 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP68485%27 HTTP/1.1" 200 None
2026-03-28 07:36:53 [auto1.de] INFO: Scrape type for MP68485: 0
2026-03-28 07:36:53 [auto1.de] INFO: Found listing with ID: JH33807
2026-03-28 07:36:53 [auto1.de] INFO: Found listing with ID: VL78522
2026-03-28 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL78522%27 HTTP/1.1" 200 None
2026-03-28 07:36:53 [auto1.de] INFO: Scrape type for VL78522: 0
2026-03-28 07:36:53 [auto1.de] INFO: Found listing with ID: UM56474
2026-03-28 07:36:53 [auto1.de] INFO: Found listing with ID: DU13995
2026-03-28 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13995%27 HTTP/1.1" 200 None
2026-03-28 07:36:53 [auto1.de] INFO: Scrape type for DU13995: 2
2026-03-28 07:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebc9efb4-df04-5936-bf0a-88c7eae0b775 with identifier: DU13995
2026-03-28 07:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebc9efb4-df04-5936-bf0a-88c7eae0b775 with scrape type 2
2026-03-28 07:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebc9efb4-df04-5936-bf0a-88c7eae0b775 with scrape type 2
2026-03-28 07:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebc9efb4-df04-5936-bf0a-88c7eae0b775, identifier: DU13995
2026-03-28 07:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebc9efb4-df04-5936-bf0a-88c7eae0b775 with identifier: DU13995
2026-03-28 07:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebc9efb4-df04-5936-bf0a-88c7eae0b775 with identifier: DU13995
2026-03-28 07:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebc9efb4-df04-5936-bf0a-88c7eae0b775 with identifier: DU13995 to the API
2026-03-28 07:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:08:53Z',
'fuel_type': 'diesel',
'id': 'ebc9efb4-df04-5936-bf0a-88c7eae0b775',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU13995',
'listing': 'auction',
'make': 'Jaguar',
'model': 'F-Pace',
'odometer': 71502,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-01',
'seller_name': None,
'title': 'Jaguar F-Pace 20d Pure AWD',
'transmission': 'automatic',
'trim': 'Pure AWD',
'year': 2016}
2026-03-28 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13995%27 HTTP/1.1" 200 None
2026-03-28 07:36:53 [auto1.de] INFO: Saving data for DU13995: {'auction_closing_time': 1774714133.0, 'created_time': 1774467173.468872, 'last_price_update_time': 1774683413.878735}
2026-03-28 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU13995') HTTP/1.1" 204 0
2026-03-28 07:36:53 [auto1.de] INFO: Found listing with ID: NV07015
2026-03-28 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV07015%27 HTTP/1.1" 200 None
2026-03-28 07:36:54 [auto1.de] INFO: Scrape type for NV07015: 0
2026-03-28 07:36:54 [auto1.de] INFO: Found listing with ID: WX35600
2026-03-28 07:36:54 [auto1.de] INFO: Found listing with ID: UN58886
2026-03-28 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN58886%27 HTTP/1.1" 200 None
2026-03-28 07:36:54 [auto1.de] INFO: Scrape type for UN58886: 0
2026-03-28 07:36:54 [auto1.de] INFO: Found listing with ID: LU68586
2026-03-28 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU68586%27 HTTP/1.1" 200 None
2026-03-28 07:36:54 [auto1.de] INFO: Scrape type for LU68586: 2
2026-03-28 07:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19996f2f-00fa-513a-aa7a-57d170ff78ae with identifier: LU68586
2026-03-28 07:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19996f2f-00fa-513a-aa7a-57d170ff78ae with scrape type 2
2026-03-28 07:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19996f2f-00fa-513a-aa7a-57d170ff78ae with scrape type 2
2026-03-28 07:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19996f2f-00fa-513a-aa7a-57d170ff78ae, identifier: LU68586
2026-03-28 07:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19996f2f-00fa-513a-aa7a-57d170ff78ae with identifier: LU68586
2026-03-28 07:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19996f2f-00fa-513a-aa7a-57d170ff78ae with identifier: LU68586
2026-03-28 07:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19996f2f-00fa-513a-aa7a-57d170ff78ae with identifier: LU68586 to the API
2026-03-28 07:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:57:56Z',
'fuel_type': 'petrol',
'id': '19996f2f-00fa-513a-aa7a-57d170ff78ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU68586',
'listing': 'auction',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 110335,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-25',
'seller_name': None,
'title': 'Toyota Aygo 1.0 X-Play Touch',
'transmission': 'manual',
'trim': 'X-Play Touch',
'year': 2015}
2026-03-28 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU68586%27 HTTP/1.1" 200 None
2026-03-28 07:36:54 [auto1.de] INFO: Saving data for LU68586: {'auction_closing_time': 1774717076.0, 'created_time': 1774464512.088127, 'last_price_update_time': 1774683414.454096}
2026-03-28 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU68586') HTTP/1.1" 204 0
2026-03-28 07:36:54 [auto1.de] INFO: Found listing with ID: AA62808
2026-03-28 07:36:54 [auto1.de] INFO: Found listing with ID: AP20693
2026-03-28 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP20693%27 HTTP/1.1" 200 None
2026-03-28 07:36:54 [auto1.de] INFO: Scrape type for AP20693: 0
2026-03-28 07:36:54 [auto1.de] INFO: Found listing with ID: UR01748
2026-03-28 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR01748%27 HTTP/1.1" 200 None
2026-03-28 07:36:54 [auto1.de] INFO: Scrape type for UR01748: 0
2026-03-28 07:36:54 [auto1.de] INFO: Found listing with ID: LN76006
2026-03-28 07:36:54 [auto1.de] INFO: Found listing with ID: KA74482
2026-03-28 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA74482%27 HTTP/1.1" 200 None
2026-03-28 07:36:54 [auto1.de] INFO: Scrape type for KA74482: 0
2026-03-28 07:36:54 [auto1.de] INFO: Found listing with ID: ZJ08757
2026-03-28 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ08757%27 HTTP/1.1" 200 None
2026-03-28 07:36:54 [auto1.de] INFO: Scrape type for ZJ08757: 0
2026-03-28 07:36:54 [auto1.de] INFO: Found listing with ID: LX71576
2026-03-28 07:36:54 [auto1.de] INFO: Found listing with ID: AC69838
2026-03-28 07:36:54 [auto1.de] INFO: Found listing with ID: PR12884
2026-03-28 07:36:54 [auto1.de] INFO: Found listing with ID: BT37883
2026-03-28 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT37883%27 HTTP/1.1" 200 None
2026-03-28 07:36:54 [auto1.de] INFO: Scrape type for BT37883: 0
2026-03-28 07:36:54 [auto1.de] INFO: Found listing with ID: PC60688
2026-03-28 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC60688%27 HTTP/1.1" 200 None
2026-03-28 07:36:54 [auto1.de] INFO: Scrape type for PC60688: 0
2026-03-28 07:36:54 [auto1.de] INFO: Found listing with ID: NT99648
2026-03-28 07:36:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:36:55 [auto1.de] INFO: Channel: 24h | Page: 80 | totalHits: 9256 | hits on page: 40
2026-03-28 07:36:55 [auto1.de] INFO: Found listing with ID: YS92779
2026-03-28 07:36:55 [auto1.de] INFO: Found listing with ID: JY95314
2026-03-28 07:36:55 [auto1.de] INFO: Found listing with ID: XH94103
2026-03-28 07:36:55 [auto1.de] INFO: Found listing with ID: LS49952
2026-03-28 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS49952%27 HTTP/1.1" 200 None
2026-03-28 07:36:55 [auto1.de] INFO: Scrape type for LS49952: 0
2026-03-28 07:36:55 [auto1.de] INFO: Found listing with ID: TS84249
2026-03-28 07:36:55 [auto1.de] INFO: Found listing with ID: JJ89633
2026-03-28 07:36:55 [auto1.de] INFO: Found listing with ID: TH50819
2026-03-28 07:36:55 [auto1.de] INFO: Found listing with ID: FJ28912
2026-03-28 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ28912%27 HTTP/1.1" 200 None
2026-03-28 07:36:55 [auto1.de] INFO: Scrape type for FJ28912: 0
2026-03-28 07:36:55 [auto1.de] INFO: Found listing with ID: WK04531
2026-03-28 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK04531%27 HTTP/1.1" 200 None
2026-03-28 07:36:55 [auto1.de] INFO: Scrape type for WK04531: 0
2026-03-28 07:36:55 [auto1.de] INFO: Found listing with ID: NX49590
2026-03-28 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX49590%27 HTTP/1.1" 200 None
2026-03-28 07:36:55 [auto1.de] INFO: Scrape type for NX49590: 2
2026-03-28 07:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6d64407-e5c9-5ebf-894c-9f41d0a9300a with identifier: NX49590
2026-03-28 07:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6d64407-e5c9-5ebf-894c-9f41d0a9300a with scrape type 2
2026-03-28 07:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6d64407-e5c9-5ebf-894c-9f41d0a9300a with scrape type 2
2026-03-28 07:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6d64407-e5c9-5ebf-894c-9f41d0a9300a, identifier: NX49590
2026-03-28 07:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6d64407-e5c9-5ebf-894c-9f41d0a9300a with identifier: NX49590
2026-03-28 07:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6d64407-e5c9-5ebf-894c-9f41d0a9300a with identifier: NX49590
2026-03-28 07:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6d64407-e5c9-5ebf-894c-9f41d0a9300a with identifier: NX49590 to the API
2026-03-28 07:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:20:45Z',
'fuel_type': 'diesel',
'id': 'f6d64407-e5c9-5ebf-894c-9f41d0a9300a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX49590',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 91426,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-18',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline',
'transmission': 'automatic',
'trim': 'Comfortline',
'year': 2009}
2026-03-28 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX49590%27 HTTP/1.1" 200 None
2026-03-28 07:36:55 [auto1.de] INFO: Saving data for NX49590: {'auction_closing_time': 1774714845.0, 'created_time': 1774467738.081448, 'last_price_update_time': 1774683415.884714}
2026-03-28 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX49590') HTTP/1.1" 204 0
2026-03-28 07:36:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:36:56 [auto1.de] INFO: Found listing with ID: CK76126
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK76126%27 HTTP/1.1" 200 None
2026-03-28 07:36:56 [auto1.de] INFO: Scrape type for CK76126: 0
2026-03-28 07:36:56 [auto1.de] INFO: Found listing with ID: GM08795
2026-03-28 07:36:56 [auto1.de] INFO: Found listing with ID: PM90514
2026-03-28 07:36:56 [auto1.de] INFO: Found listing with ID: TT68659
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT68659%27 HTTP/1.1" 200 None
2026-03-28 07:36:56 [auto1.de] INFO: Scrape type for TT68659: 0
2026-03-28 07:36:56 [auto1.de] INFO: Found listing with ID: EA46191
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA46191%27 HTTP/1.1" 200 None
2026-03-28 07:36:56 [auto1.de] INFO: Scrape type for EA46191: 0
2026-03-28 07:36:56 [auto1.de] INFO: Found listing with ID: LC63229
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC63229%27 HTTP/1.1" 200 None
2026-03-28 07:36:56 [auto1.de] INFO: Scrape type for LC63229: 0
2026-03-28 07:36:56 [auto1.de] INFO: Found listing with ID: YD12708
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD12708%27 HTTP/1.1" 200 None
2026-03-28 07:36:56 [auto1.de] INFO: Scrape type for YD12708: 0
2026-03-28 07:36:56 [auto1.de] INFO: Found listing with ID: SF95135
2026-03-28 07:36:56 [auto1.de] INFO: Found listing with ID: GW25108
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW25108%27 HTTP/1.1" 200 None
2026-03-28 07:36:56 [auto1.de] INFO: Scrape type for GW25108: 0
2026-03-28 07:36:56 [auto1.de] INFO: Found listing with ID: ND58698
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND58698%27 HTTP/1.1" 200 None
2026-03-28 07:36:56 [auto1.de] INFO: Scrape type for ND58698: 0
2026-03-28 07:36:56 [auto1.de] INFO: Found listing with ID: CA65942
2026-03-28 07:36:56 [auto1.de] INFO: Found listing with ID: YK99793
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK99793%27 HTTP/1.1" 200 None
2026-03-28 07:36:56 [auto1.de] INFO: Scrape type for YK99793: 2
2026-03-28 07:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ceeb7190-b8f8-5d3d-b920-fcc1b7f6c393 with identifier: YK99793
2026-03-28 07:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ceeb7190-b8f8-5d3d-b920-fcc1b7f6c393 with scrape type 2
2026-03-28 07:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ceeb7190-b8f8-5d3d-b920-fcc1b7f6c393 with scrape type 2
2026-03-28 07:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ceeb7190-b8f8-5d3d-b920-fcc1b7f6c393, identifier: YK99793
2026-03-28 07:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ceeb7190-b8f8-5d3d-b920-fcc1b7f6c393 with identifier: YK99793
2026-03-28 07:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ceeb7190-b8f8-5d3d-b920-fcc1b7f6c393 with identifier: YK99793
2026-03-28 07:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ceeb7190-b8f8-5d3d-b920-fcc1b7f6c393 with identifier: YK99793 to the API
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:27:17Z',
'fuel_type': 'petrol',
'id': 'ceeb7190-b8f8-5d3d-b920-fcc1b7f6c393',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK99793',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 169004,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-08',
'seller_name': None,
'title': 'Nissan Qashqai 1.2 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2017}
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK99793%27 HTTP/1.1" 200 None
2026-03-28 07:36:56 [auto1.de] INFO: Saving data for YK99793: {'auction_closing_time': 1774715237.0, 'created_time': 1774466458.276929, 'last_price_update_time': 1774683416.617641}
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YK99793') HTTP/1.1" 204 0
2026-03-28 07:36:56 [auto1.de] INFO: Found listing with ID: BF84298
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF84298%27 HTTP/1.1" 200 None
2026-03-28 07:36:56 [auto1.de] INFO: Scrape type for BF84298: 0
2026-03-28 07:36:56 [auto1.de] INFO: Found listing with ID: KT12333
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT12333%27 HTTP/1.1" 200 None
2026-03-28 07:36:56 [auto1.de] INFO: Scrape type for KT12333: 0
2026-03-28 07:36:56 [auto1.de] INFO: Found listing with ID: SE74775
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE74775%27 HTTP/1.1" 200 None
2026-03-28 07:36:56 [auto1.de] INFO: Scrape type for SE74775: 2
2026-03-28 07:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54e47fdc-2275-5d94-b9c0-4549b5dfb2e5 with identifier: SE74775
2026-03-28 07:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54e47fdc-2275-5d94-b9c0-4549b5dfb2e5 with scrape type 2
2026-03-28 07:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54e47fdc-2275-5d94-b9c0-4549b5dfb2e5 with scrape type 2
2026-03-28 07:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54e47fdc-2275-5d94-b9c0-4549b5dfb2e5, identifier: SE74775
2026-03-28 07:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54e47fdc-2275-5d94-b9c0-4549b5dfb2e5 with identifier: SE74775
2026-03-28 07:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54e47fdc-2275-5d94-b9c0-4549b5dfb2e5 with identifier: SE74775
2026-03-28 07:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54e47fdc-2275-5d94-b9c0-4549b5dfb2e5 with identifier: SE74775 to the API
2026-03-28 07:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:28:11Z',
'fuel_type': 'diesel',
'id': '54e47fdc-2275-5d94-b9c0-4549b5dfb2e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE74775',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC40',
'odometer': 45850,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-21',
'seller_name': None,
'title': 'Volvo XC40 2.0 D3 R-Design 2WD',
'transmission': 'automatic',
'trim': 'R-Design 2WD',
'year': 2020}
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE74775%27 HTTP/1.1" 200 None
2026-03-28 07:36:57 [auto1.de] INFO: Saving data for SE74775: {'auction_closing_time': 1774715291.0, 'created_time': 1774465857.160272, 'last_price_update_time': 1774683417.165718}
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE74775') HTTP/1.1" 204 0
2026-03-28 07:36:57 [auto1.de] INFO: Found listing with ID: RL13206
2026-03-28 07:36:57 [auto1.de] INFO: Found listing with ID: VR66092
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR66092%27 HTTP/1.1" 200 None
2026-03-28 07:36:57 [auto1.de] INFO: Scrape type for VR66092: 0
2026-03-28 07:36:57 [auto1.de] INFO: Found listing with ID: KH31418
2026-03-28 07:36:57 [auto1.de] INFO: Found listing with ID: LA57205
2026-03-28 07:36:57 [auto1.de] INFO: Found listing with ID: BY14877
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY14877%27 HTTP/1.1" 200 None
2026-03-28 07:36:57 [auto1.de] INFO: Scrape type for BY14877: 0
2026-03-28 07:36:57 [auto1.de] INFO: Found listing with ID: UC83372
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC83372%27 HTTP/1.1" 200 None
2026-03-28 07:36:57 [auto1.de] INFO: Scrape type for UC83372: 0
2026-03-28 07:36:57 [auto1.de] INFO: Found listing with ID: HY14352
2026-03-28 07:36:57 [auto1.de] INFO: Found listing with ID: MR23969
2026-03-28 07:36:57 [auto1.de] INFO: Found listing with ID: JV02966
2026-03-28 07:36:57 [auto1.de] INFO: Found listing with ID: LN11625
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN11625%27 HTTP/1.1" 200 None
2026-03-28 07:36:57 [auto1.de] INFO: Scrape type for LN11625: 0
2026-03-28 07:36:57 [auto1.de] INFO: Found listing with ID: TK27520
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK27520%27 HTTP/1.1" 200 None
2026-03-28 07:36:57 [auto1.de] INFO: Scrape type for TK27520: 0
2026-03-28 07:36:57 [auto1.de] INFO: Found listing with ID: CJ75099
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ75099%27 HTTP/1.1" 200 None
2026-03-28 07:36:57 [auto1.de] INFO: Scrape type for CJ75099: 2
2026-03-28 07:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7640eab9-49b6-5eba-9aed-fad4f94bc312 with identifier: CJ75099
2026-03-28 07:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7640eab9-49b6-5eba-9aed-fad4f94bc312 with scrape type 2
2026-03-28 07:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7640eab9-49b6-5eba-9aed-fad4f94bc312 with scrape type 2
2026-03-28 07:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7640eab9-49b6-5eba-9aed-fad4f94bc312, identifier: CJ75099
2026-03-28 07:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7640eab9-49b6-5eba-9aed-fad4f94bc312 with identifier: CJ75099
2026-03-28 07:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7640eab9-49b6-5eba-9aed-fad4f94bc312 with identifier: CJ75099
2026-03-28 07:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7640eab9-49b6-5eba-9aed-fad4f94bc312 with identifier: CJ75099 to the API
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 177,
'expiration_date': '2026-03-28T16:43:30Z',
'fuel_type': 'diesel',
'id': '7640eab9-49b6-5eba-9aed-fad4f94bc312',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ75099',
'listing': 'auction',
'make': 'Opel',
'model': 'Vivaro',
'odometer': 120426,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-14',
'seller_name': None,
'title': 'Opel Vivaro 2.0 CDTI L INNOVATION L3',
'transmission': 'automatic',
'trim': 'L INNOVATION L3',
'year': 2020}
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ75099%27 HTTP/1.1" 200 None
2026-03-28 07:36:57 [auto1.de] INFO: Saving data for CJ75099: {'auction_closing_time': 1774716210.0, 'created_time': 1774034324.213871, 'last_price_update_time': 1774683417.692313}
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ75099') HTTP/1.1" 204 0
2026-03-28 07:36:57 [auto1.de] INFO: Found listing with ID: WN20430
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN20430%27 HTTP/1.1" 200 None
2026-03-28 07:36:57 [auto1.de] INFO: Scrape type for WN20430: 0
2026-03-28 07:36:57 [auto1.de] INFO: Found listing with ID: WE79254
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE79254%27 HTTP/1.1" 200 None
2026-03-28 07:36:57 [auto1.de] INFO: Scrape type for WE79254: 0
2026-03-28 07:36:57 [auto1.de] INFO: Found listing with ID: GV90609
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV90609%27 HTTP/1.1" 200 None
2026-03-28 07:36:57 [auto1.de] INFO: Scrape type for GV90609: 0
2026-03-28 07:36:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:36:58 [auto1.de] INFO: Channel: 24h | Page: 81 | totalHits: 9256 | hits on page: 40
2026-03-28 07:36:58 [auto1.de] INFO: Found listing with ID: LF76340
2026-03-28 07:36:58 [auto1.de] INFO: Found listing with ID: NA81558
2026-03-28 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA81558%27 HTTP/1.1" 200 None
2026-03-28 07:36:58 [auto1.de] INFO: Scrape type for NA81558: 0
2026-03-28 07:36:58 [auto1.de] INFO: Found listing with ID: RP40821
2026-03-28 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP40821%27 HTTP/1.1" 200 None
2026-03-28 07:36:58 [auto1.de] INFO: Scrape type for RP40821: 2
2026-03-28 07:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 703ccf8c-a195-504d-b260-e6904310d2c4 with identifier: RP40821
2026-03-28 07:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 703ccf8c-a195-504d-b260-e6904310d2c4 with scrape type 2
2026-03-28 07:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 703ccf8c-a195-504d-b260-e6904310d2c4 with scrape type 2
2026-03-28 07:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 703ccf8c-a195-504d-b260-e6904310d2c4, identifier: RP40821
2026-03-28 07:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 703ccf8c-a195-504d-b260-e6904310d2c4 with identifier: RP40821
2026-03-28 07:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 703ccf8c-a195-504d-b260-e6904310d2c4 with identifier: RP40821
2026-03-28 07:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 703ccf8c-a195-504d-b260-e6904310d2c4 with identifier: RP40821 to the API
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:52:04Z',
'fuel_type': 'petrol',
'id': '703ccf8c-a195-504d-b260-e6904310d2c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP40821',
'listing': 'auction',
'make': 'Honda',
'model': 'Civic',
'odometer': 122078,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-11-20',
'seller_name': None,
'title': 'Honda Civic 1.8 VTEC Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2006}
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP40821%27 HTTP/1.1" 200 None
2026-03-28 07:36:59 [auto1.de] INFO: Saving data for RP40821: {'auction_closing_time': 1774716724.0, 'created_time': 1773859396.585738, 'last_price_update_time': 1774683419.283077}
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP40821') HTTP/1.1" 204 0
2026-03-28 07:36:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:36:59 [auto1.de] INFO: Found listing with ID: PB76196
2026-03-28 07:36:59 [auto1.de] INFO: Found listing with ID: WP86079
2026-03-28 07:36:59 [auto1.de] INFO: Found listing with ID: XU28434
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU28434%27 HTTP/1.1" 200 None
2026-03-28 07:36:59 [auto1.de] INFO: Scrape type for XU28434: 0
2026-03-28 07:36:59 [auto1.de] INFO: Found listing with ID: NE13487
2026-03-28 07:36:59 [auto1.de] INFO: Found listing with ID: YB31045
2026-03-28 07:36:59 [auto1.de] INFO: Found listing with ID: WJ62953
2026-03-28 07:36:59 [auto1.de] INFO: Found listing with ID: GN74176
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN74176%27 HTTP/1.1" 200 None
2026-03-28 07:36:59 [auto1.de] INFO: Scrape type for GN74176: 0
2026-03-28 07:36:59 [auto1.de] INFO: Found listing with ID: KT54325
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT54325%27 HTTP/1.1" 200 None
2026-03-28 07:36:59 [auto1.de] INFO: Scrape type for KT54325: 0
2026-03-28 07:36:59 [auto1.de] INFO: Found listing with ID: RR48020
2026-03-28 07:36:59 [auto1.de] INFO: Found listing with ID: ZY58366
2026-03-28 07:36:59 [auto1.de] INFO: Found listing with ID: NV16003
2026-03-28 07:36:59 [auto1.de] INFO: Found listing with ID: DS59487
2026-03-28 07:36:59 [auto1.de] INFO: Found listing with ID: GJ17165
2026-03-28 07:36:59 [auto1.de] INFO: Found listing with ID: YT23335
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT23335%27 HTTP/1.1" 200 None
2026-03-28 07:36:59 [auto1.de] INFO: Scrape type for YT23335: 0
2026-03-28 07:36:59 [auto1.de] INFO: Found listing with ID: LK79875
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK79875%27 HTTP/1.1" 200 None
2026-03-28 07:36:59 [auto1.de] INFO: Scrape type for LK79875: 0
2026-03-28 07:36:59 [auto1.de] INFO: Found listing with ID: NH12576
2026-03-28 07:36:59 [auto1.de] INFO: Found listing with ID: WD80617
2026-03-28 07:36:59 [auto1.de] INFO: Found listing with ID: ZF45936
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF45936%27 HTTP/1.1" 200 None
2026-03-28 07:36:59 [auto1.de] INFO: Scrape type for ZF45936: 0
2026-03-28 07:36:59 [auto1.de] INFO: Found listing with ID: BX28873
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX28873%27 HTTP/1.1" 200 None
2026-03-28 07:36:59 [auto1.de] INFO: Scrape type for BX28873: 2
2026-03-28 07:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e28e799-6508-5172-bad5-6a8f93ed3ca2 with identifier: BX28873
2026-03-28 07:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e28e799-6508-5172-bad5-6a8f93ed3ca2 with scrape type 2
2026-03-28 07:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e28e799-6508-5172-bad5-6a8f93ed3ca2 with scrape type 2
2026-03-28 07:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e28e799-6508-5172-bad5-6a8f93ed3ca2, identifier: BX28873
2026-03-28 07:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e28e799-6508-5172-bad5-6a8f93ed3ca2 with identifier: BX28873
2026-03-28 07:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e28e799-6508-5172-bad5-6a8f93ed3ca2 with identifier: BX28873
2026-03-28 07:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e28e799-6508-5172-bad5-6a8f93ed3ca2 with identifier: BX28873 to the API
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:37:47Z',
'fuel_type': 'petrol',
'id': '5e28e799-6508-5172-bad5-6a8f93ed3ca2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX28873',
'listing': 'auction',
'make': 'Mazda',
'model': '3',
'odometer': 126230,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-09',
'seller_name': None,
'title': 'Mazda 3 2.0 Center-Line',
'transmission': 'manual',
'trim': 'Center-Line',
'year': 2015}
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX28873%27 HTTP/1.1" 200 None
2026-03-28 07:36:59 [auto1.de] INFO: Saving data for BX28873: {'auction_closing_time': 1774715867.0, 'created_time': 1773860529.304376, 'last_price_update_time': 1774683419.849885}
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX28873') HTTP/1.1" 204 0
2026-03-28 07:36:59 [auto1.de] INFO: Found listing with ID: VK38709
2026-03-28 07:36:59 [auto1.de] INFO: Found listing with ID: JH99279
2026-03-28 07:36:59 [auto1.de] INFO: Found listing with ID: YR20535
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR20535%27 HTTP/1.1" 200 None
2026-03-28 07:36:59 [auto1.de] INFO: Scrape type for YR20535: 0
2026-03-28 07:36:59 [auto1.de] INFO: Found listing with ID: RY66150
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY66150%27 HTTP/1.1" 200 None
2026-03-28 07:36:59 [auto1.de] INFO: Scrape type for RY66150: 2
2026-03-28 07:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1210602-c462-5925-a719-290b5b792906 with identifier: RY66150
2026-03-28 07:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1210602-c462-5925-a719-290b5b792906 with scrape type 2
2026-03-28 07:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1210602-c462-5925-a719-290b5b792906 with scrape type 2
2026-03-28 07:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1210602-c462-5925-a719-290b5b792906, identifier: RY66150
2026-03-28 07:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1210602-c462-5925-a719-290b5b792906 with identifier: RY66150
2026-03-28 07:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1210602-c462-5925-a719-290b5b792906 with identifier: RY66150
2026-03-28 07:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1210602-c462-5925-a719-290b5b792906 with identifier: RY66150 to the API
2026-03-28 07:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:40:40Z',
'fuel_type': 'petrol',
'id': 'd1210602-c462-5925-a719-290b5b792906',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY66150',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira',
'odometer': 194790,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-12-22',
'seller_name': None,
'title': 'Opel Zafira 1.8 Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2008}
2026-03-28 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY66150%27 HTTP/1.1" 200 None
2026-03-28 07:37:00 [auto1.de] INFO: Saving data for RY66150: {'auction_closing_time': 1774716040.0, 'created_time': 1774468121.699829, 'last_price_update_time': 1774683420.427215}
2026-03-28 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY66150') HTTP/1.1" 204 0
2026-03-28 07:37:00 [auto1.de] INFO: Found listing with ID: ZU61192
2026-03-28 07:37:00 [auto1.de] INFO: Found listing with ID: YD60070
2026-03-28 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD60070%27 HTTP/1.1" 200 None
2026-03-28 07:37:00 [auto1.de] INFO: Scrape type for YD60070: 0
2026-03-28 07:37:00 [auto1.de] INFO: Found listing with ID: CJ93593
2026-03-28 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ93593%27 HTTP/1.1" 200 None
2026-03-28 07:37:00 [auto1.de] INFO: Scrape type for CJ93593: 0
2026-03-28 07:37:00 [auto1.de] INFO: Found listing with ID: PE09652
2026-03-28 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE09652%27 HTTP/1.1" 200 None
2026-03-28 07:37:00 [auto1.de] INFO: Scrape type for PE09652: 0
2026-03-28 07:37:00 [auto1.de] INFO: Found listing with ID: DF95353
2026-03-28 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF95353%27 HTTP/1.1" 200 None
2026-03-28 07:37:00 [auto1.de] INFO: Scrape type for DF95353: 0
2026-03-28 07:37:00 [auto1.de] INFO: Found listing with ID: AJ62547
2026-03-28 07:37:00 [auto1.de] INFO: Found listing with ID: ZC42699
2026-03-28 07:37:00 [auto1.de] INFO: Found listing with ID: FW21815
2026-03-28 07:37:00 [auto1.de] INFO: Found listing with ID: EE47451
2026-03-28 07:37:00 [auto1.de] INFO: Found listing with ID: YL37879
2026-03-28 07:37:00 [auto1.de] INFO: Found listing with ID: SZ45535
2026-03-28 07:37:00 [auto1.de] INFO: Found listing with ID: MC30685
2026-03-28 07:37:00 [auto1.de] INFO: Found listing with ID: TX40951
2026-03-28 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40951%27 HTTP/1.1" 200 None
2026-03-28 07:37:00 [auto1.de] INFO: Scrape type for TX40951: 0
2026-03-28 07:37:00 [auto1.de] INFO: Found listing with ID: DL80875
2026-03-28 07:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:37:01 [auto1.de] INFO: Channel: 24h | Page: 82 | totalHits: 9256 | hits on page: 40
2026-03-28 07:37:01 [auto1.de] INFO: Found listing with ID: JD76793
2026-03-28 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD76793%27 HTTP/1.1" 200 None
2026-03-28 07:37:01 [auto1.de] INFO: Scrape type for JD76793: 0
2026-03-28 07:37:01 [auto1.de] INFO: Found listing with ID: AP12446
2026-03-28 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP12446%27 HTTP/1.1" 200 None
2026-03-28 07:37:01 [auto1.de] INFO: Scrape type for AP12446: 0
2026-03-28 07:37:01 [auto1.de] INFO: Found listing with ID: KE84614
2026-03-28 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE84614%27 HTTP/1.1" 200 None
2026-03-28 07:37:01 [auto1.de] INFO: Scrape type for KE84614: 0
2026-03-28 07:37:01 [auto1.de] INFO: Found listing with ID: VJ09038
2026-03-28 07:37:01 [auto1.de] INFO: Found listing with ID: FD89715
2026-03-28 07:37:01 [auto1.de] INFO: Found listing with ID: FC97863
2026-03-28 07:37:01 [auto1.de] INFO: Found listing with ID: PF74105
2026-03-28 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF74105%27 HTTP/1.1" 200 None
2026-03-28 07:37:01 [auto1.de] INFO: Scrape type for PF74105: 0
2026-03-28 07:37:01 [auto1.de] INFO: Found listing with ID: ZX76617
2026-03-28 07:37:01 [auto1.de] INFO: Found listing with ID: VH66319
2026-03-28 07:37:01 [auto1.de] INFO: Found listing with ID: ME61701
2026-03-28 07:37:01 [auto1.de] INFO: Found listing with ID: NZ68458
2026-03-28 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ68458%27 HTTP/1.1" 200 None
2026-03-28 07:37:01 [auto1.de] INFO: Scrape type for NZ68458: 0
2026-03-28 07:37:01 [auto1.de] INFO: Found listing with ID: CW02492
2026-03-28 07:37:01 [auto1.de] INFO: Found listing with ID: PN40620
2026-03-28 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN40620%27 HTTP/1.1" 200 None
2026-03-28 07:37:01 [auto1.de] INFO: Scrape type for PN40620: 0
2026-03-28 07:37:01 [auto1.de] INFO: Found listing with ID: ER00491
2026-03-28 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER00491%27 HTTP/1.1" 200 None
2026-03-28 07:37:01 [auto1.de] INFO: Scrape type for ER00491: 2
2026-03-28 07:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 264c043b-65c6-5d45-8736-635d08fc1fea with identifier: ER00491
2026-03-28 07:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 264c043b-65c6-5d45-8736-635d08fc1fea with scrape type 2
2026-03-28 07:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 264c043b-65c6-5d45-8736-635d08fc1fea with scrape type 2
2026-03-28 07:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 264c043b-65c6-5d45-8736-635d08fc1fea, identifier: ER00491
2026-03-28 07:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 264c043b-65c6-5d45-8736-635d08fc1fea with identifier: ER00491
2026-03-28 07:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 264c043b-65c6-5d45-8736-635d08fc1fea with identifier: ER00491
2026-03-28 07:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 264c043b-65c6-5d45-8736-635d08fc1fea with identifier: ER00491 to the API
2026-03-28 07:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 239,
'expiration_date': '2026-03-28T16:00:35Z',
'fuel_type': 'diesel',
'id': '264c043b-65c6-5d45-8736-635d08fc1fea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER00491',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 103056,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-06',
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 BiTDI RS 4x4',
'transmission': 'automatic',
'trim': 'RS 4x4',
'year': 2019}
2026-03-28 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER00491%27 HTTP/1.1" 200 None
2026-03-28 07:37:02 [auto1.de] INFO: Saving data for ER00491: {'auction_closing_time': 1774713635.0, 'created_time': 1774464653.155678, 'last_price_update_time': 1774683422.657445}
2026-03-28 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER00491') HTTP/1.1" 204 0
2026-03-28 07:37:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:37:02 [auto1.de] INFO: Found listing with ID: PX22927
2026-03-28 07:37:02 [auto1.de] INFO: Found listing with ID: RY31497
2026-03-28 07:37:02 [auto1.de] INFO: Found listing with ID: NR66161
2026-03-28 07:37:02 [auto1.de] INFO: Found listing with ID: TT40648
2026-03-28 07:37:02 [auto1.de] INFO: Found listing with ID: WR53064
2026-03-28 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR53064%27 HTTP/1.1" 200 None
2026-03-28 07:37:02 [auto1.de] INFO: Scrape type for WR53064: 0
2026-03-28 07:37:02 [auto1.de] INFO: Found listing with ID: JJ67232
2026-03-28 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ67232%27 HTTP/1.1" 200 None
2026-03-28 07:37:02 [auto1.de] INFO: Scrape type for JJ67232: 0
2026-03-28 07:37:02 [auto1.de] INFO: Found listing with ID: KA00227
2026-03-28 07:37:02 [auto1.de] INFO: Found listing with ID: KZ45391
2026-03-28 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ45391%27 HTTP/1.1" 200 None
2026-03-28 07:37:02 [auto1.de] INFO: Scrape type for KZ45391: 0
2026-03-28 07:37:02 [auto1.de] INFO: Found listing with ID: PA67996
2026-03-28 07:37:02 [auto1.de] INFO: Found listing with ID: VC74515
2026-03-28 07:37:02 [auto1.de] INFO: Found listing with ID: WW75764
2026-03-28 07:37:02 [auto1.de] INFO: Found listing with ID: XF93739
2026-03-28 07:37:02 [auto1.de] INFO: Found listing with ID: RT01969
2026-03-28 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT01969%27 HTTP/1.1" 200 None
2026-03-28 07:37:02 [auto1.de] INFO: Scrape type for RT01969: 0
2026-03-28 07:37:02 [auto1.de] INFO: Found listing with ID: VS51720
2026-03-28 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS51720%27 HTTP/1.1" 200 None
2026-03-28 07:37:02 [auto1.de] INFO: Scrape type for VS51720: 0
2026-03-28 07:37:02 [auto1.de] INFO: Found listing with ID: BJ03544
2026-03-28 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ03544%27 HTTP/1.1" 200 None
2026-03-28 07:37:02 [auto1.de] INFO: Scrape type for BJ03544: 0
2026-03-28 07:37:02 [auto1.de] INFO: Found listing with ID: XL60244
2026-03-28 07:37:02 [auto1.de] INFO: Found listing with ID: TZ46793
2026-03-28 07:37:02 [auto1.de] INFO: Found listing with ID: CX62190
2026-03-28 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX62190%27 HTTP/1.1" 200 None
2026-03-28 07:37:02 [auto1.de] INFO: Scrape type for CX62190: 0
2026-03-28 07:37:02 [auto1.de] INFO: Found listing with ID: AJ07817
2026-03-28 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ07817%27 HTTP/1.1" 200 None
2026-03-28 07:37:02 [auto1.de] INFO: Scrape type for AJ07817: 2
2026-03-28 07:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2470cfcf-f6d4-586c-9b50-1611414fc64e with identifier: AJ07817
2026-03-28 07:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2470cfcf-f6d4-586c-9b50-1611414fc64e with scrape type 2
2026-03-28 07:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2470cfcf-f6d4-586c-9b50-1611414fc64e with scrape type 2
2026-03-28 07:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2470cfcf-f6d4-586c-9b50-1611414fc64e, identifier: AJ07817
2026-03-28 07:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2470cfcf-f6d4-586c-9b50-1611414fc64e with identifier: AJ07817
2026-03-28 07:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2470cfcf-f6d4-586c-9b50-1611414fc64e with identifier: AJ07817
2026-03-28 07:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2470cfcf-f6d4-586c-9b50-1611414fc64e with identifier: AJ07817 to the API
2026-03-28 07:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-28T16:29:06Z',
'fuel_type': 'hybrid',
'id': '2470cfcf-f6d4-586c-9b50-1611414fc64e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ07817',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 59748,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-17',
'seller_name': None,
'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium X',
'transmission': 'automatic',
'trim': 'Titanium X',
'year': 2022}
2026-03-28 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ07817%27 HTTP/1.1" 200 None
2026-03-28 07:37:03 [auto1.de] INFO: Saving data for AJ07817: {'auction_closing_time': 1774715346.0, 'created_time': 1774463670.47931, 'last_price_update_time': 1774683423.971181}
2026-03-28 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ07817') HTTP/1.1" 204 0
2026-03-28 07:37:04 [auto1.de] INFO: Found listing with ID: LR92682
2026-03-28 07:37:04 [auto1.de] INFO: Found listing with ID: JP07657
2026-03-28 07:37:04 [auto1.de] INFO: Found listing with ID: FA90244
2026-03-28 07:37:04 [auto1.de] INFO: Found listing with ID: NT47334
2026-03-28 07:37:04 [auto1.de] INFO: Found listing with ID: FJ58055
2026-03-28 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ58055%27 HTTP/1.1" 200 None
2026-03-28 07:37:04 [auto1.de] INFO: Scrape type for FJ58055: 0
2026-03-28 07:37:04 [auto1.de] INFO: Found listing with ID: TS29154
2026-03-28 07:37:04 [auto1.de] INFO: Found listing with ID: WC76278
2026-03-28 07:37:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:37:05 [auto1.de] INFO: Channel: 24h | Page: 83 | totalHits: 9256 | hits on page: 40
2026-03-28 07:37:05 [auto1.de] INFO: Found listing with ID: VB04886
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB04886%27 HTTP/1.1" 200 None
2026-03-28 07:37:05 [auto1.de] INFO: Scrape type for VB04886: 0
2026-03-28 07:37:05 [auto1.de] INFO: Found listing with ID: BZ01431
2026-03-28 07:37:05 [auto1.de] INFO: Found listing with ID: XX76692
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX76692%27 HTTP/1.1" 200 None
2026-03-28 07:37:05 [auto1.de] INFO: Scrape type for XX76692: 0
2026-03-28 07:37:05 [auto1.de] INFO: Found listing with ID: JN99222
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN99222%27 HTTP/1.1" 200 None
2026-03-28 07:37:05 [auto1.de] INFO: Scrape type for JN99222: 0
2026-03-28 07:37:05 [auto1.de] INFO: Found listing with ID: US78573
2026-03-28 07:37:05 [auto1.de] INFO: Found listing with ID: NT27416
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT27416%27 HTTP/1.1" 200 None
2026-03-28 07:37:05 [auto1.de] INFO: Scrape type for NT27416: 0
2026-03-28 07:37:05 [auto1.de] INFO: Found listing with ID: YJ10280
2026-03-28 07:37:05 [auto1.de] INFO: Found listing with ID: CU60081
2026-03-28 07:37:05 [auto1.de] INFO: Found listing with ID: BB96456
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB96456%27 HTTP/1.1" 200 None
2026-03-28 07:37:05 [auto1.de] INFO: Scrape type for BB96456: 0
2026-03-28 07:37:05 [auto1.de] INFO: Found listing with ID: AY98929
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY98929%27 HTTP/1.1" 200 None
2026-03-28 07:37:05 [auto1.de] INFO: Scrape type for AY98929: 0
2026-03-28 07:37:05 [auto1.de] INFO: Found listing with ID: LJ65322
2026-03-28 07:37:05 [auto1.de] INFO: Found listing with ID: DJ56711
2026-03-28 07:37:05 [auto1.de] INFO: Found listing with ID: PH74270
2026-03-28 07:37:05 [auto1.de] INFO: Found listing with ID: ZX03854
2026-03-28 07:37:05 [auto1.de] INFO: Found listing with ID: JD13909
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD13909%27 HTTP/1.1" 200 None
2026-03-28 07:37:05 [auto1.de] INFO: Scrape type for JD13909: 0
2026-03-28 07:37:05 [auto1.de] INFO: Found listing with ID: CM83282
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM83282%27 HTTP/1.1" 200 None
2026-03-28 07:37:05 [auto1.de] INFO: Scrape type for CM83282: 2
2026-03-28 07:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 293678e2-a396-5cd4-bdb2-d1c75c6781fc with identifier: CM83282
2026-03-28 07:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 293678e2-a396-5cd4-bdb2-d1c75c6781fc with scrape type 2
2026-03-28 07:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 293678e2-a396-5cd4-bdb2-d1c75c6781fc with scrape type 2
2026-03-28 07:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 293678e2-a396-5cd4-bdb2-d1c75c6781fc, identifier: CM83282
2026-03-28 07:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 293678e2-a396-5cd4-bdb2-d1c75c6781fc with identifier: CM83282
2026-03-28 07:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 293678e2-a396-5cd4-bdb2-d1c75c6781fc with identifier: CM83282
2026-03-28 07:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 293678e2-a396-5cd4-bdb2-d1c75c6781fc with identifier: CM83282 to the API
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:57:26Z',
'fuel_type': 'petrol',
'id': '293678e2-a396-5cd4-bdb2-d1c75c6781fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM83282',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 154492,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-08-25',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 200 Kompressor T Classic',
'transmission': 'automatic',
'trim': 'T Classic',
'year': 2002}
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM83282%27 HTTP/1.1" 200 None
2026-03-28 07:37:05 [auto1.de] INFO: Saving data for CM83282: {'auction_closing_time': 1774717046.0, 'created_time': 1773301389.161036, 'last_price_update_time': 1774683425.644154}
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM83282') HTTP/1.1" 204 0
2026-03-28 07:37:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:37:05 [auto1.de] INFO: Found listing with ID: RD09031
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD09031%27 HTTP/1.1" 200 None
2026-03-28 07:37:05 [auto1.de] INFO: Scrape type for RD09031: 0
2026-03-28 07:37:05 [auto1.de] INFO: Found listing with ID: CZ43316
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ43316%27 HTTP/1.1" 200 None
2026-03-28 07:37:05 [auto1.de] INFO: Scrape type for CZ43316: 0
2026-03-28 07:37:05 [auto1.de] INFO: Found listing with ID: EY98011
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY98011%27 HTTP/1.1" 200 None
2026-03-28 07:37:05 [auto1.de] INFO: Scrape type for EY98011: 0
2026-03-28 07:37:05 [auto1.de] INFO: Found listing with ID: PB95967
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB95967%27 HTTP/1.1" 200 None
2026-03-28 07:37:05 [auto1.de] INFO: Scrape type for PB95967: 0
2026-03-28 07:37:05 [auto1.de] INFO: Found listing with ID: WJ04835
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ04835%27 HTTP/1.1" 200 None
2026-03-28 07:37:05 [auto1.de] INFO: Scrape type for WJ04835: 0
2026-03-28 07:37:05 [auto1.de] INFO: Found listing with ID: WD56041
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD56041%27 HTTP/1.1" 200 None
2026-03-28 07:37:05 [auto1.de] INFO: Scrape type for WD56041: 2
2026-03-28 07:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f2dae68-9346-577f-ad8a-6e5ef25c188d with identifier: WD56041
2026-03-28 07:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f2dae68-9346-577f-ad8a-6e5ef25c188d with scrape type 2
2026-03-28 07:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f2dae68-9346-577f-ad8a-6e5ef25c188d with scrape type 2
2026-03-28 07:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f2dae68-9346-577f-ad8a-6e5ef25c188d, identifier: WD56041
2026-03-28 07:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f2dae68-9346-577f-ad8a-6e5ef25c188d with identifier: WD56041
2026-03-28 07:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f2dae68-9346-577f-ad8a-6e5ef25c188d with identifier: WD56041
2026-03-28 07:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f2dae68-9346-577f-ad8a-6e5ef25c188d with identifier: WD56041 to the API
2026-03-28 07:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:51:58Z',
'fuel_type': 'diesel',
'id': '8f2dae68-9346-577f-ad8a-6e5ef25c188d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD56041',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 100786,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-10',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2020}
2026-03-28 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD56041%27 HTTP/1.1" 200 None
2026-03-28 07:37:07 [auto1.de] INFO: Saving data for WD56041: {'auction_closing_time': 1774716718.0, 'created_time': 1774467286.274928, 'last_price_update_time': 1774683427.055882}
2026-03-28 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD56041') HTTP/1.1" 204 0
2026-03-28 07:37:07 [auto1.de] INFO: Found listing with ID: CT53281
2026-03-28 07:37:07 [auto1.de] INFO: Found listing with ID: MA84823
2026-03-28 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA84823%27 HTTP/1.1" 200 None
2026-03-28 07:37:07 [auto1.de] INFO: Scrape type for MA84823: 0
2026-03-28 07:37:07 [auto1.de] INFO: Found listing with ID: XE05025
2026-03-28 07:37:07 [auto1.de] INFO: Found listing with ID: UF59044
2026-03-28 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF59044%27 HTTP/1.1" 200 None
2026-03-28 07:37:07 [auto1.de] INFO: Scrape type for UF59044: 0
2026-03-28 07:37:07 [auto1.de] INFO: Found listing with ID: WX92371
2026-03-28 07:37:07 [auto1.de] INFO: Found listing with ID: KC84817
2026-03-28 07:37:07 [auto1.de] INFO: Found listing with ID: UB19219
2026-03-28 07:37:07 [auto1.de] INFO: Found listing with ID: BM18767
2026-03-28 07:37:07 [auto1.de] INFO: Found listing with ID: SH08334
2026-03-28 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH08334%27 HTTP/1.1" 200 None
2026-03-28 07:37:07 [auto1.de] INFO: Scrape type for SH08334: 0
2026-03-28 07:37:07 [auto1.de] INFO: Found listing with ID: HE72355
2026-03-28 07:37:07 [auto1.de] INFO: Found listing with ID: PP85770
2026-03-28 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP85770%27 HTTP/1.1" 200 None
2026-03-28 07:37:07 [auto1.de] INFO: Scrape type for PP85770: 0
2026-03-28 07:37:07 [auto1.de] INFO: Found listing with ID: VN69903
2026-03-28 07:37:07 [auto1.de] INFO: Found listing with ID: AX39550
2026-03-28 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX39550%27 HTTP/1.1" 200 None
2026-03-28 07:37:07 [auto1.de] INFO: Scrape type for AX39550: 0
2026-03-28 07:37:07 [auto1.de] INFO: Found listing with ID: XF65798
2026-03-28 07:37:07 [auto1.de] INFO: Found listing with ID: CN60683
2026-03-28 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN60683%27 HTTP/1.1" 200 None
2026-03-28 07:37:07 [auto1.de] INFO: Scrape type for CN60683: 2
2026-03-28 07:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 660254aa-bb61-5b8b-a43c-c189b9f7f4ad with identifier: CN60683
2026-03-28 07:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 660254aa-bb61-5b8b-a43c-c189b9f7f4ad with scrape type 2
2026-03-28 07:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 660254aa-bb61-5b8b-a43c-c189b9f7f4ad with scrape type 2
2026-03-28 07:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 660254aa-bb61-5b8b-a43c-c189b9f7f4ad, identifier: CN60683
2026-03-28 07:37:07 [scrapy.extensions.logstats] INFO: Crawled 89 pages (at 17 pages/min), scraped 333 items (at 54 items/min)
2026-03-28 07:37:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 165MiB
2026-03-28 07:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 660254aa-bb61-5b8b-a43c-c189b9f7f4ad with identifier: CN60683
2026-03-28 07:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 660254aa-bb61-5b8b-a43c-c189b9f7f4ad with identifier: CN60683
2026-03-28 07:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 660254aa-bb61-5b8b-a43c-c189b9f7f4ad with identifier: CN60683 to the API
2026-03-28 07:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 201,
'expiration_date': '2026-03-28T16:27:35Z',
'fuel_type': 'diesel',
'id': '660254aa-bb61-5b8b-a43c-c189b9f7f4ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN60683',
'listing': 'auction',
'make': 'KGM',
'model': 'Musso Grand',
'odometer': 22740,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-06-02',
'seller_name': None,
'title': 'KGM Musso Grand 2.2 e-Xdi Style AWD',
'transmission': 'automatic',
'trim': 'Style AWD',
'year': 2025}
2026-03-28 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN60683%27 HTTP/1.1" 200 None
2026-03-28 07:37:08 [auto1.de] INFO: Saving data for CN60683: {'auction_closing_time': 1774715255.0, 'created_time': 1773859663.699041, 'last_price_update_time': 1774683428.659581}
2026-03-28 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN60683') HTTP/1.1" 204 0
2026-03-28 07:37:08 [auto1.de] INFO: Found listing with ID: FD98026
2026-03-28 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD98026%27 HTTP/1.1" 200 None
2026-03-28 07:37:08 [auto1.de] INFO: Scrape type for FD98026: 2
2026-03-28 07:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cf741f0-4f99-5fb4-b290-fc2921dd304a with identifier: FD98026
2026-03-28 07:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cf741f0-4f99-5fb4-b290-fc2921dd304a with scrape type 2
2026-03-28 07:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cf741f0-4f99-5fb4-b290-fc2921dd304a with scrape type 2
2026-03-28 07:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1cf741f0-4f99-5fb4-b290-fc2921dd304a, identifier: FD98026
2026-03-28 07:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1cf741f0-4f99-5fb4-b290-fc2921dd304a with identifier: FD98026
2026-03-28 07:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1cf741f0-4f99-5fb4-b290-fc2921dd304a with identifier: FD98026
2026-03-28 07:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1cf741f0-4f99-5fb4-b290-fc2921dd304a with identifier: FD98026 to the API
2026-03-28 07:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:24:23Z',
'fuel_type': 'diesel',
'id': '1cf741f0-4f99-5fb4-b290-fc2921dd304a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD98026',
'listing': 'auction',
'make': 'Opel',
'model': 'Vivaro',
'odometer': 75011,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-28',
'seller_name': None,
'title': 'Opel Vivaro 1.5 CDTI M Edition L2',
'transmission': 'manual',
'trim': 'M Edition L2',
'year': 2022}
2026-03-28 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD98026%27 HTTP/1.1" 200 None
2026-03-28 07:37:09 [auto1.de] INFO: Saving data for FD98026: {'auction_closing_time': 1774715063.0, 'created_time': 1774467183.248485, 'last_price_update_time': 1774683429.26963}
2026-03-28 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD98026') HTTP/1.1" 204 0
2026-03-28 07:37:09 [auto1.de] INFO: Found listing with ID: AT70928
2026-03-28 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT70928%27 HTTP/1.1" 200 None
2026-03-28 07:37:09 [auto1.de] INFO: Scrape type for AT70928: 0
2026-03-28 07:37:09 [auto1.de] INFO: Found listing with ID: JT51313
2026-03-28 07:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:37:10 [auto1.de] INFO: Channel: 24h | Page: 84 | totalHits: 9256 | hits on page: 40
2026-03-28 07:37:10 [auto1.de] INFO: Found listing with ID: AN45666
2026-03-28 07:37:10 [auto1.de] INFO: Found listing with ID: TT67137
2026-03-28 07:37:10 [auto1.de] INFO: Found listing with ID: TW44839
2026-03-28 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW44839%27 HTTP/1.1" 200 None
2026-03-28 07:37:10 [auto1.de] INFO: Scrape type for TW44839: 0
2026-03-28 07:37:10 [auto1.de] INFO: Found listing with ID: DK51297
2026-03-28 07:37:10 [auto1.de] INFO: Found listing with ID: WX26579
2026-03-28 07:37:10 [auto1.de] INFO: Found listing with ID: ZH86268
2026-03-28 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH86268%27 HTTP/1.1" 200 None
2026-03-28 07:37:10 [auto1.de] INFO: Scrape type for ZH86268: 0
2026-03-28 07:37:10 [auto1.de] INFO: Found listing with ID: AP13896
2026-03-28 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP13896%27 HTTP/1.1" 200 None
2026-03-28 07:37:10 [auto1.de] INFO: Scrape type for AP13896: 0
2026-03-28 07:37:10 [auto1.de] INFO: Found listing with ID: DR46257
2026-03-28 07:37:10 [auto1.de] INFO: Found listing with ID: EF20977
2026-03-28 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF20977%27 HTTP/1.1" 200 None
2026-03-28 07:37:10 [auto1.de] INFO: Scrape type for EF20977: 2
2026-03-28 07:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7ff14fc-bc77-5d56-9eee-14e267e69288 with identifier: EF20977
2026-03-28 07:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7ff14fc-bc77-5d56-9eee-14e267e69288 with scrape type 2
2026-03-28 07:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7ff14fc-bc77-5d56-9eee-14e267e69288 with scrape type 2
2026-03-28 07:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7ff14fc-bc77-5d56-9eee-14e267e69288, identifier: EF20977
2026-03-28 07:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7ff14fc-bc77-5d56-9eee-14e267e69288 with identifier: EF20977
2026-03-28 07:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7ff14fc-bc77-5d56-9eee-14e267e69288 with identifier: EF20977
2026-03-28 07:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7ff14fc-bc77-5d56-9eee-14e267e69288 with identifier: EF20977 to the API
2026-03-28 07:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:27:13Z',
'fuel_type': 'petrol',
'id': 'a7ff14fc-bc77-5d56-9eee-14e267e69288',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF20977',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 88461,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-28',
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2016}
2026-03-28 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF20977%27 HTTP/1.1" 200 None
2026-03-28 07:37:11 [auto1.de] INFO: Saving data for EF20977: {'auction_closing_time': 1774715233.0, 'created_time': 1774463908.222709, 'last_price_update_time': 1774683431.674533}
2026-03-28 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EF20977') HTTP/1.1" 204 0
2026-03-28 07:37:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:37:11 [auto1.de] INFO: Found listing with ID: XC72019
2026-03-28 07:37:11 [auto1.de] INFO: Found listing with ID: JG35367
2026-03-28 07:37:11 [auto1.de] INFO: Found listing with ID: TF67733
2026-03-28 07:37:11 [auto1.de] INFO: Found listing with ID: WC68946
2026-03-28 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC68946%27 HTTP/1.1" 200 None
2026-03-28 07:37:11 [auto1.de] INFO: Scrape type for WC68946: 0
2026-03-28 07:37:11 [auto1.de] INFO: Found listing with ID: JB95370
2026-03-28 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB95370%27 HTTP/1.1" 200 None
2026-03-28 07:37:11 [auto1.de] INFO: Scrape type for JB95370: 0
2026-03-28 07:37:11 [auto1.de] INFO: Found listing with ID: HF35410
2026-03-28 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF35410%27 HTTP/1.1" 200 None
2026-03-28 07:37:11 [auto1.de] INFO: Scrape type for HF35410: 0
2026-03-28 07:37:11 [auto1.de] INFO: Found listing with ID: DP00162
2026-03-28 07:37:11 [auto1.de] INFO: Found listing with ID: FA98642
2026-03-28 07:37:11 [auto1.de] INFO: Found listing with ID: XP88597
2026-03-28 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP88597%27 HTTP/1.1" 200 None
2026-03-28 07:37:11 [auto1.de] INFO: Scrape type for XP88597: 0
2026-03-28 07:37:11 [auto1.de] INFO: Found listing with ID: MC27583
2026-03-28 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC27583%27 HTTP/1.1" 200 None
2026-03-28 07:37:11 [auto1.de] INFO: Scrape type for MC27583: 0
2026-03-28 07:37:11 [auto1.de] INFO: Found listing with ID: RJ38519
2026-03-28 07:37:11 [auto1.de] INFO: Found listing with ID: JY58234
2026-03-28 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY58234%27 HTTP/1.1" 200 None
2026-03-28 07:37:11 [auto1.de] INFO: Scrape type for JY58234: 2
2026-03-28 07:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 171a73df-2fbc-54c9-8d7f-70664254b3cb with identifier: JY58234
2026-03-28 07:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 171a73df-2fbc-54c9-8d7f-70664254b3cb with scrape type 2
2026-03-28 07:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 171a73df-2fbc-54c9-8d7f-70664254b3cb with scrape type 2
2026-03-28 07:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 171a73df-2fbc-54c9-8d7f-70664254b3cb, identifier: JY58234
2026-03-28 07:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 171a73df-2fbc-54c9-8d7f-70664254b3cb with identifier: JY58234
2026-03-28 07:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 171a73df-2fbc-54c9-8d7f-70664254b3cb with identifier: JY58234
2026-03-28 07:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 171a73df-2fbc-54c9-8d7f-70664254b3cb with identifier: JY58234 to the API
2026-03-28 07:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:31:53Z',
'fuel_type': 'diesel',
'id': '171a73df-2fbc-54c9-8d7f-70664254b3cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY58234',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 182953,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-03',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2019}
2026-03-28 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY58234%27 HTTP/1.1" 200 None
2026-03-28 07:37:13 [auto1.de] INFO: Saving data for JY58234: {'auction_closing_time': 1774715513.0, 'created_time': 1774466591.494687, 'last_price_update_time': 1774683433.445252}
2026-03-28 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY58234') HTTP/1.1" 204 0
2026-03-28 07:37:13 [auto1.de] INFO: Found listing with ID: CA68070
2026-03-28 07:37:13 [auto1.de] INFO: Found listing with ID: TS97270
2026-03-28 07:37:13 [auto1.de] INFO: Found listing with ID: UR35427
2026-03-28 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR35427%27 HTTP/1.1" 200 None
2026-03-28 07:37:13 [auto1.de] INFO: Scrape type for UR35427: 2
2026-03-28 07:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce4e36ba-a0af-53d2-b043-91db7a324831 with identifier: UR35427
2026-03-28 07:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce4e36ba-a0af-53d2-b043-91db7a324831 with scrape type 2
2026-03-28 07:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce4e36ba-a0af-53d2-b043-91db7a324831 with scrape type 2
2026-03-28 07:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce4e36ba-a0af-53d2-b043-91db7a324831, identifier: UR35427
2026-03-28 07:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce4e36ba-a0af-53d2-b043-91db7a324831 with identifier: UR35427
2026-03-28 07:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce4e36ba-a0af-53d2-b043-91db7a324831 with identifier: UR35427
2026-03-28 07:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce4e36ba-a0af-53d2-b043-91db7a324831 with identifier: UR35427 to the API
2026-03-28 07:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-28T16:54:41Z',
'fuel_type': 'hybrid',
'id': 'ce4e36ba-a0af-53d2-b043-91db7a324831',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR35427',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 40759,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-30',
'seller_name': None,
'title': 'Peugeot 3008 1.6 Hybrid 225 GT',
'transmission': 'automatic',
'trim': '225 GT',
'year': 2022}
2026-03-28 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR35427%27 HTTP/1.1" 200 None
2026-03-28 07:37:14 [auto1.de] INFO: Saving data for UR35427: {'auction_closing_time': 1774716881.0, 'created_time': 1774466446.249586, 'last_price_update_time': 1774683434.133432}
2026-03-28 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR35427') HTTP/1.1" 204 0
2026-03-28 07:37:14 [auto1.de] INFO: Found listing with ID: YY00170
2026-03-28 07:37:14 [auto1.de] INFO: Found listing with ID: YW63189
2026-03-28 07:37:14 [auto1.de] INFO: Found listing with ID: FU28651
2026-03-28 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU28651%27 HTTP/1.1" 200 None
2026-03-28 07:37:14 [auto1.de] INFO: Scrape type for FU28651: 0
2026-03-28 07:37:14 [auto1.de] INFO: Found listing with ID: LT13241
2026-03-28 07:37:14 [auto1.de] INFO: Found listing with ID: KS68262
2026-03-28 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS68262%27 HTTP/1.1" 200 None
2026-03-28 07:37:14 [auto1.de] INFO: Scrape type for KS68262: 0
2026-03-28 07:37:14 [auto1.de] INFO: Found listing with ID: PC84380
2026-03-28 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC84380%27 HTTP/1.1" 200 None
2026-03-28 07:37:14 [auto1.de] INFO: Scrape type for PC84380: 2
2026-03-28 07:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92e548b5-19f7-5077-b6d7-19990e5aa924 with identifier: PC84380
2026-03-28 07:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92e548b5-19f7-5077-b6d7-19990e5aa924 with scrape type 2
2026-03-28 07:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92e548b5-19f7-5077-b6d7-19990e5aa924 with scrape type 2
2026-03-28 07:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92e548b5-19f7-5077-b6d7-19990e5aa924, identifier: PC84380
2026-03-28 07:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92e548b5-19f7-5077-b6d7-19990e5aa924 with identifier: PC84380
2026-03-28 07:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92e548b5-19f7-5077-b6d7-19990e5aa924 with identifier: PC84380
2026-03-28 07:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92e548b5-19f7-5077-b6d7-19990e5aa924 with identifier: PC84380 to the API
2026-03-28 07:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 367,
'expiration_date': '2026-03-28T16:36:28Z',
'fuel_type': 'hybrid',
'id': '92e548b5-19f7-5077-b6d7-19990e5aa924',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC84380',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 51222,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-11',
'seller_name': None,
'title': 'Audi Q5 55 TFSIe quattro sport',
'transmission': 'automatic',
'trim': 'quattro sport',
'year': 2020}
2026-03-28 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC84380%27 HTTP/1.1" 200 None
2026-03-28 07:37:14 [auto1.de] INFO: Saving data for PC84380: {'auction_closing_time': 1774715788.0, 'created_time': 1774463764.102757, 'last_price_update_time': 1774683434.671527}
2026-03-28 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC84380') HTTP/1.1" 204 0
2026-03-28 07:37:14 [auto1.de] INFO: Found listing with ID: DL80467
2026-03-28 07:37:14 [auto1.de] INFO: Found listing with ID: YL76472
2026-03-28 07:37:14 [auto1.de] INFO: Found listing with ID: LP13779
2026-03-28 07:37:14 [auto1.de] INFO: Found listing with ID: EK27182
2026-03-28 07:37:14 [auto1.de] INFO: Found listing with ID: RB24690
2026-03-28 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB24690%27 HTTP/1.1" 200 None
2026-03-28 07:37:14 [auto1.de] INFO: Scrape type for RB24690: 0
2026-03-28 07:37:14 [auto1.de] INFO: Found listing with ID: JA21059
2026-03-28 07:37:14 [auto1.de] INFO: Found listing with ID: MX11677
2026-03-28 07:37:14 [auto1.de] INFO: Found listing with ID: KU93910
2026-03-28 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU93910%27 HTTP/1.1" 200 None
2026-03-28 07:37:14 [auto1.de] INFO: Scrape type for KU93910: 0
2026-03-28 07:37:14 [auto1.de] INFO: Found listing with ID: JN06918
2026-03-28 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN06918%27 HTTP/1.1" 200 None
2026-03-28 07:37:14 [auto1.de] INFO: Scrape type for JN06918: 0
2026-03-28 07:37:14 [auto1.de] INFO: Found listing with ID: XX85563
2026-03-28 07:37:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:37:15 [auto1.de] INFO: Channel: 24h | Page: 85 | totalHits: 9256 | hits on page: 40
2026-03-28 07:37:15 [auto1.de] INFO: Found listing with ID: SS51493
2026-03-28 07:37:15 [auto1.de] INFO: Found listing with ID: XE44885
2026-03-28 07:37:15 [auto1.de] INFO: Found listing with ID: PY07137
2026-03-28 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY07137%27 HTTP/1.1" 200 None
2026-03-28 07:37:15 [auto1.de] INFO: Scrape type for PY07137: 0
2026-03-28 07:37:15 [auto1.de] INFO: Found listing with ID: ZU35501
2026-03-28 07:37:15 [auto1.de] INFO: Found listing with ID: JX05743
2026-03-28 07:37:15 [auto1.de] INFO: Found listing with ID: RT10354
2026-03-28 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT10354%27 HTTP/1.1" 200 None
2026-03-28 07:37:15 [auto1.de] INFO: Scrape type for RT10354: 0
2026-03-28 07:37:15 [auto1.de] INFO: Found listing with ID: WP32637
2026-03-28 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP32637%27 HTTP/1.1" 200 None
2026-03-28 07:37:15 [auto1.de] INFO: Scrape type for WP32637: 2
2026-03-28 07:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1f54603-9b80-5076-9d5b-9db4e59db9ef with identifier: WP32637
2026-03-28 07:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1f54603-9b80-5076-9d5b-9db4e59db9ef with scrape type 2
2026-03-28 07:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1f54603-9b80-5076-9d5b-9db4e59db9ef with scrape type 2
2026-03-28 07:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1f54603-9b80-5076-9d5b-9db4e59db9ef, identifier: WP32637
2026-03-28 07:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1f54603-9b80-5076-9d5b-9db4e59db9ef with identifier: WP32637
2026-03-28 07:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1f54603-9b80-5076-9d5b-9db4e59db9ef with identifier: WP32637
2026-03-28 07:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1f54603-9b80-5076-9d5b-9db4e59db9ef with identifier: WP32637 to the API
2026-03-28 07:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-28T16:52:55Z',
'fuel_type': 'diesel',
'id': 'b1f54603-9b80-5076-9d5b-9db4e59db9ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP32637',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 193973,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-07',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 300 d T Avantgarde',
'transmission': 'automatic',
'trim': 'T Avantgarde',
'year': 2019}
2026-03-28 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP32637%27 HTTP/1.1" 200 None
2026-03-28 07:37:16 [auto1.de] INFO: Saving data for WP32637: {'auction_closing_time': 1774716775.0, 'created_time': 1774465628.440206, 'last_price_update_time': 1774683436.647064}
2026-03-28 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP32637') HTTP/1.1" 204 0
2026-03-28 07:37:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:37:16 [auto1.de] INFO: Found listing with ID: SG38319
2026-03-28 07:37:16 [auto1.de] INFO: Found listing with ID: BV43542
2026-03-28 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV43542%27 HTTP/1.1" 200 None
2026-03-28 07:37:16 [auto1.de] INFO: Scrape type for BV43542: 0
2026-03-28 07:37:16 [auto1.de] INFO: Found listing with ID: US71908
2026-03-28 07:37:16 [auto1.de] INFO: Found listing with ID: PU73316
2026-03-28 07:37:16 [auto1.de] INFO: Found listing with ID: BY01569
2026-03-28 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY01569%27 HTTP/1.1" 200 None
2026-03-28 07:37:16 [auto1.de] INFO: Scrape type for BY01569: 0
2026-03-28 07:37:16 [auto1.de] INFO: Found listing with ID: LB77280
2026-03-28 07:37:16 [auto1.de] INFO: Found listing with ID: AV44518
2026-03-28 07:37:16 [auto1.de] INFO: Found listing with ID: UE92744
2026-03-28 07:37:16 [auto1.de] INFO: Found listing with ID: TK51417
2026-03-28 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK51417%27 HTTP/1.1" 200 None
2026-03-28 07:37:16 [auto1.de] INFO: Scrape type for TK51417: 0
2026-03-28 07:37:16 [auto1.de] INFO: Found listing with ID: BG37416
2026-03-28 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG37416%27 HTTP/1.1" 200 None
2026-03-28 07:37:16 [auto1.de] INFO: Scrape type for BG37416: 0
2026-03-28 07:37:16 [auto1.de] INFO: Found listing with ID: BV81502
2026-03-28 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV81502%27 HTTP/1.1" 200 None
2026-03-28 07:37:16 [auto1.de] INFO: Scrape type for BV81502: 0
2026-03-28 07:37:16 [auto1.de] INFO: Found listing with ID: JH74007
2026-03-28 07:37:16 [auto1.de] INFO: Found listing with ID: NN39507
2026-03-28 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN39507%27 HTTP/1.1" 200 None
2026-03-28 07:37:16 [auto1.de] INFO: Scrape type for NN39507: 2
2026-03-28 07:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 206d013c-5bca-57be-8c57-cc8850354fbe with identifier: NN39507
2026-03-28 07:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 206d013c-5bca-57be-8c57-cc8850354fbe with scrape type 2
2026-03-28 07:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 206d013c-5bca-57be-8c57-cc8850354fbe with scrape type 2
2026-03-28 07:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 206d013c-5bca-57be-8c57-cc8850354fbe, identifier: NN39507
2026-03-28 07:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 206d013c-5bca-57be-8c57-cc8850354fbe with identifier: NN39507
2026-03-28 07:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 206d013c-5bca-57be-8c57-cc8850354fbe with identifier: NN39507
2026-03-28 07:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 206d013c-5bca-57be-8c57-cc8850354fbe with identifier: NN39507 to the API
2026-03-28 07:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:22:16Z',
'fuel_type': 'petrol',
'id': '206d013c-5bca-57be-8c57-cc8850354fbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN39507',
'listing': 'auction',
'make': 'Smart',
'model': 'forfour',
'odometer': 53765,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-01',
'seller_name': None,
'title': 'Smart forfour 0.9 Turbo Basis passion',
'transmission': 'automatic',
'trim': 'Basis passion',
'year': 2018}
2026-03-28 07:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN39507%27 HTTP/1.1" 200 None
2026-03-28 07:37:17 [auto1.de] INFO: Saving data for NN39507: {'auction_closing_time': 1774714936.0, 'created_time': 1774465142.512557, 'last_price_update_time': 1774683437.416956}
2026-03-28 07:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN39507') HTTP/1.1" 204 0
2026-03-28 07:37:17 [auto1.de] INFO: Found listing with ID: LC01777
2026-03-28 07:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC01777%27 HTTP/1.1" 200 None
2026-03-28 07:37:17 [auto1.de] INFO: Scrape type for LC01777: 0
2026-03-28 07:37:17 [auto1.de] INFO: Found listing with ID: ZV97129
2026-03-28 07:37:17 [auto1.de] INFO: Found listing with ID: VK57644
2026-03-28 07:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK57644%27 HTTP/1.1" 200 None
2026-03-28 07:37:17 [auto1.de] INFO: Scrape type for VK57644: 0
2026-03-28 07:37:17 [auto1.de] INFO: Found listing with ID: VU62087
2026-03-28 07:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU62087%27 HTTP/1.1" 200 None
2026-03-28 07:37:17 [auto1.de] INFO: Scrape type for VU62087: 0
2026-03-28 07:37:17 [auto1.de] INFO: Found listing with ID: BP04527
2026-03-28 07:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP04527%27 HTTP/1.1" 200 None
2026-03-28 07:37:17 [auto1.de] INFO: Scrape type for BP04527: 0
2026-03-28 07:37:17 [auto1.de] INFO: Found listing with ID: ST72008
2026-03-28 07:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST72008%27 HTTP/1.1" 200 None
2026-03-28 07:37:17 [auto1.de] INFO: Scrape type for ST72008: 2
2026-03-28 07:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72cdf9b6-2dd2-5657-84d0-71565109f2cb with identifier: ST72008
2026-03-28 07:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72cdf9b6-2dd2-5657-84d0-71565109f2cb with scrape type 2
2026-03-28 07:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72cdf9b6-2dd2-5657-84d0-71565109f2cb with scrape type 2
2026-03-28 07:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72cdf9b6-2dd2-5657-84d0-71565109f2cb, identifier: ST72008
2026-03-28 07:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72cdf9b6-2dd2-5657-84d0-71565109f2cb with identifier: ST72008
2026-03-28 07:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72cdf9b6-2dd2-5657-84d0-71565109f2cb with identifier: ST72008
2026-03-28 07:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72cdf9b6-2dd2-5657-84d0-71565109f2cb with identifier: ST72008 to the API
2026-03-28 07:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:28:16Z',
'fuel_type': 'petrol',
'id': '72cdf9b6-2dd2-5657-84d0-71565109f2cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST72008',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 183943,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-20',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Trendline BlueMotion Tech',
'year': 2013}
2026-03-28 07:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST72008%27 HTTP/1.1" 200 None
2026-03-28 07:37:18 [auto1.de] INFO: Saving data for ST72008: {'auction_closing_time': 1774715296.0, 'created_time': 1773829851.060605, 'last_price_update_time': 1774683438.179575}
2026-03-28 07:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST72008') HTTP/1.1" 204 0
2026-03-28 07:37:18 [auto1.de] INFO: Found listing with ID: CR84704
2026-03-28 07:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR84704%27 HTTP/1.1" 200 None
2026-03-28 07:37:18 [auto1.de] INFO: Scrape type for CR84704: 0
2026-03-28 07:37:18 [auto1.de] INFO: Found listing with ID: XU56057
2026-03-28 07:37:18 [auto1.de] INFO: Found listing with ID: FU46952
2026-03-28 07:37:18 [auto1.de] INFO: Found listing with ID: RK13717
2026-03-28 07:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK13717%27 HTTP/1.1" 200 None
2026-03-28 07:37:18 [auto1.de] INFO: Scrape type for RK13717: 0
2026-03-28 07:37:18 [auto1.de] INFO: Found listing with ID: HG52162
2026-03-28 07:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG52162%27 HTTP/1.1" 200 None
2026-03-28 07:37:18 [auto1.de] INFO: Scrape type for HG52162: 0
2026-03-28 07:37:18 [auto1.de] INFO: Found listing with ID: XP80923
2026-03-28 07:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP80923%27 HTTP/1.1" 200 None
2026-03-28 07:37:18 [auto1.de] INFO: Scrape type for XP80923: 2
2026-03-28 07:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2460ea9-9e57-5c45-9b40-4497bb6ca363 with identifier: XP80923
2026-03-28 07:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2460ea9-9e57-5c45-9b40-4497bb6ca363 with scrape type 2
2026-03-28 07:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2460ea9-9e57-5c45-9b40-4497bb6ca363 with scrape type 2
2026-03-28 07:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2460ea9-9e57-5c45-9b40-4497bb6ca363, identifier: XP80923
2026-03-28 07:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2460ea9-9e57-5c45-9b40-4497bb6ca363 with identifier: XP80923
2026-03-28 07:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2460ea9-9e57-5c45-9b40-4497bb6ca363 with identifier: XP80923
2026-03-28 07:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2460ea9-9e57-5c45-9b40-4497bb6ca363 with identifier: XP80923 to the API
2026-03-28 07:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:08:34Z',
'fuel_type': 'diesel',
'id': 'b2460ea9-9e57-5c45-9b40-4497bb6ca363',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP80923',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 113858,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-04',
'seller_name': None,
'title': 'BMW 1er 116d EfficientDynamics Edition',
'transmission': 'manual',
'trim': 'EfficientDynamics Edition',
'year': 2014}
2026-03-28 07:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP80923%27 HTTP/1.1" 200 None
2026-03-28 07:37:19 [auto1.de] INFO: Saving data for XP80923: {'auction_closing_time': 1774714114.0, 'created_time': 1774467473.436767, 'last_price_update_time': 1774683439.49724}
2026-03-28 07:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP80923') HTTP/1.1" 204 0
2026-03-28 07:37:19 [auto1.de] INFO: Found listing with ID: TC50609
2026-03-28 07:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC50609%27 HTTP/1.1" 200 None
2026-03-28 07:37:19 [auto1.de] INFO: Scrape type for TC50609: 0
2026-03-28 07:37:19 [auto1.de] INFO: Found listing with ID: SN43229
2026-03-28 07:37:19 [auto1.de] INFO: Found listing with ID: RX17782
2026-03-28 07:37:19 [auto1.de] INFO: Found listing with ID: JJ76956
2026-03-28 07:37:19 [auto1.de] INFO: Found listing with ID: BZ43252
2026-03-28 07:37:19 [auto1.de] INFO: Found listing with ID: TH64703
2026-03-28 07:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH64703%27 HTTP/1.1" 200 None
2026-03-28 07:37:19 [auto1.de] INFO: Scrape type for TH64703: 0
2026-03-28 07:37:19 [auto1.de] INFO: Found listing with ID: AC00549
2026-03-28 07:37:19 [auto1.de] INFO: Found listing with ID: DF79170
2026-03-28 07:37:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:37:20 [auto1.de] INFO: Channel: 24h | Page: 86 | totalHits: 9256 | hits on page: 40
2026-03-28 07:37:20 [auto1.de] INFO: Found listing with ID: FE12352
2026-03-28 07:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE12352%27 HTTP/1.1" 200 None
2026-03-28 07:37:20 [auto1.de] INFO: Scrape type for FE12352: 0
2026-03-28 07:37:20 [auto1.de] INFO: Found listing with ID: PJ00212
2026-03-28 07:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ00212%27 HTTP/1.1" 200 None
2026-03-28 07:37:20 [auto1.de] INFO: Scrape type for PJ00212: 0
2026-03-28 07:37:20 [auto1.de] INFO: Found listing with ID: YY60165
2026-03-28 07:37:20 [auto1.de] INFO: Found listing with ID: BP89276
2026-03-28 07:37:20 [auto1.de] INFO: Found listing with ID: BL42626
2026-03-28 07:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL42626%27 HTTP/1.1" 200 None
2026-03-28 07:37:20 [auto1.de] INFO: Scrape type for BL42626: 0
2026-03-28 07:37:20 [auto1.de] INFO: Found listing with ID: CE66063
2026-03-28 07:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE66063%27 HTTP/1.1" 200 None
2026-03-28 07:37:20 [auto1.de] INFO: Scrape type for CE66063: 0
2026-03-28 07:37:20 [auto1.de] INFO: Found listing with ID: WF56073
2026-03-28 07:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF56073%27 HTTP/1.1" 200 None
2026-03-28 07:37:20 [auto1.de] INFO: Scrape type for WF56073: 0
2026-03-28 07:37:20 [auto1.de] INFO: Found listing with ID: BX01019
2026-03-28 07:37:20 [auto1.de] INFO: Found listing with ID: KP49252
2026-03-28 07:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP49252%27 HTTP/1.1" 200 None
2026-03-28 07:37:20 [auto1.de] INFO: Scrape type for KP49252: 2
2026-03-28 07:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ad2b0e1-1b20-5329-86d9-e6c84edb084b with identifier: KP49252
2026-03-28 07:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ad2b0e1-1b20-5329-86d9-e6c84edb084b with scrape type 2
2026-03-28 07:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ad2b0e1-1b20-5329-86d9-e6c84edb084b with scrape type 2
2026-03-28 07:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ad2b0e1-1b20-5329-86d9-e6c84edb084b, identifier: KP49252
2026-03-28 07:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ad2b0e1-1b20-5329-86d9-e6c84edb084b with identifier: KP49252
2026-03-28 07:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ad2b0e1-1b20-5329-86d9-e6c84edb084b with identifier: KP49252
2026-03-28 07:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ad2b0e1-1b20-5329-86d9-e6c84edb084b with identifier: KP49252 to the API
2026-03-28 07:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:50:02Z',
'fuel_type': 'petrol',
'id': '4ad2b0e1-1b20-5329-86d9-e6c84edb084b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP49252',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 146552,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-23',
'seller_name': None,
'title': 'Seat Leon 1.8 TSI X-Perience 4Drive',
'transmission': 'automatic',
'trim': 'X-Perience 4Drive',
'year': 2015}
2026-03-28 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP49252%27 HTTP/1.1" 200 None
2026-03-28 07:37:21 [auto1.de] INFO: Saving data for KP49252: {'auction_closing_time': 1774716602.0, 'created_time': 1774467751.010714, 'last_price_update_time': 1774683441.285122}
2026-03-28 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP49252') HTTP/1.1" 204 0
2026-03-28 07:37:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:37:21 [auto1.de] INFO: Found listing with ID: BJ62056
2026-03-28 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ62056%27 HTTP/1.1" 200 None
2026-03-28 07:37:21 [auto1.de] INFO: Scrape type for BJ62056: 2
2026-03-28 07:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5ac0b7f-50f2-5066-a462-728a516aaf43 with identifier: BJ62056
2026-03-28 07:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5ac0b7f-50f2-5066-a462-728a516aaf43 with scrape type 2
2026-03-28 07:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5ac0b7f-50f2-5066-a462-728a516aaf43 with scrape type 2
2026-03-28 07:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5ac0b7f-50f2-5066-a462-728a516aaf43, identifier: BJ62056
2026-03-28 07:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5ac0b7f-50f2-5066-a462-728a516aaf43 with identifier: BJ62056
2026-03-28 07:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5ac0b7f-50f2-5066-a462-728a516aaf43 with identifier: BJ62056
2026-03-28 07:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5ac0b7f-50f2-5066-a462-728a516aaf43 with identifier: BJ62056 to the API
2026-03-28 07:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:26:13Z',
'fuel_type': 'diesel',
'id': 'a5ac0b7f-50f2-5066-a462-728a516aaf43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ62056',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 159539,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-26',
'seller_name': None,
'title': 'Mercedes-Benz Vito 110 CDI lang',
'transmission': 'manual',
'trim': 'lang',
'year': 2013}
2026-03-28 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ62056%27 HTTP/1.1" 200 None
2026-03-28 07:37:21 [auto1.de] INFO: Saving data for BJ62056: {'auction_closing_time': 1774715173.0, 'created_time': 1774466298.794263, 'last_price_update_time': 1774683441.837692}
2026-03-28 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ62056') HTTP/1.1" 204 0
2026-03-28 07:37:21 [auto1.de] INFO: Found listing with ID: KJ62910
2026-03-28 07:37:21 [auto1.de] INFO: Found listing with ID: YJ35877
2026-03-28 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ35877%27 HTTP/1.1" 200 None
2026-03-28 07:37:21 [auto1.de] INFO: Scrape type for YJ35877: 0
2026-03-28 07:37:21 [auto1.de] INFO: Found listing with ID: YN11150
2026-03-28 07:37:21 [auto1.de] INFO: Found listing with ID: AE03495
2026-03-28 07:37:21 [auto1.de] INFO: Found listing with ID: NS67917
2026-03-28 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS67917%27 HTTP/1.1" 200 None
2026-03-28 07:37:21 [auto1.de] INFO: Scrape type for NS67917: 0
2026-03-28 07:37:21 [auto1.de] INFO: Found listing with ID: DG70282
2026-03-28 07:37:21 [auto1.de] INFO: Found listing with ID: CL06528
2026-03-28 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL06528%27 HTTP/1.1" 200 None
2026-03-28 07:37:21 [auto1.de] INFO: Scrape type for CL06528: 0
2026-03-28 07:37:21 [auto1.de] INFO: Found listing with ID: JU71873
2026-03-28 07:37:21 [auto1.de] INFO: Found listing with ID: PZ79327
2026-03-28 07:37:21 [auto1.de] INFO: Found listing with ID: DD55179
2026-03-28 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD55179%27 HTTP/1.1" 200 None
2026-03-28 07:37:21 [auto1.de] INFO: Scrape type for DD55179: 2
2026-03-28 07:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9b1a1ad-674f-533f-b091-bfb7505c8308 with identifier: DD55179
2026-03-28 07:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9b1a1ad-674f-533f-b091-bfb7505c8308 with scrape type 2
2026-03-28 07:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9b1a1ad-674f-533f-b091-bfb7505c8308 with scrape type 2
2026-03-28 07:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9b1a1ad-674f-533f-b091-bfb7505c8308, identifier: DD55179
2026-03-28 07:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9b1a1ad-674f-533f-b091-bfb7505c8308 with identifier: DD55179
2026-03-28 07:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9b1a1ad-674f-533f-b091-bfb7505c8308 with identifier: DD55179
2026-03-28 07:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9b1a1ad-674f-533f-b091-bfb7505c8308 with identifier: DD55179 to the API
2026-03-28 07:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:32:34Z',
'fuel_type': 'petrol',
'id': 'a9b1a1ad-674f-533f-b091-bfb7505c8308',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD55179',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 121343,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-10',
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TSI Sportline 4x4',
'transmission': 'automatic',
'trim': 'Sportline 4x4',
'year': 2020}
2026-03-28 07:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD55179%27 HTTP/1.1" 200 None
2026-03-28 07:37:23 [auto1.de] INFO: Saving data for DD55179: {'auction_closing_time': 1774715554.0, 'created_time': 1774466011.358548, 'last_price_update_time': 1774683443.412049}
2026-03-28 07:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD55179') HTTP/1.1" 204 0
2026-03-28 07:37:23 [auto1.de] INFO: Found listing with ID: BJ16226
2026-03-28 07:37:23 [auto1.de] INFO: Found listing with ID: LG11243
2026-03-28 07:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG11243%27 HTTP/1.1" 200 None
2026-03-28 07:37:23 [auto1.de] INFO: Scrape type for LG11243: 0
2026-03-28 07:37:23 [auto1.de] INFO: Found listing with ID: CX80626
2026-03-28 07:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX80626%27 HTTP/1.1" 200 None
2026-03-28 07:37:23 [auto1.de] INFO: Scrape type for CX80626: 2
2026-03-28 07:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 470528fa-a731-5129-a3ef-9e244f608ff2 with identifier: CX80626
2026-03-28 07:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 470528fa-a731-5129-a3ef-9e244f608ff2 with scrape type 2
2026-03-28 07:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 470528fa-a731-5129-a3ef-9e244f608ff2 with scrape type 2
2026-03-28 07:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 470528fa-a731-5129-a3ef-9e244f608ff2, identifier: CX80626
2026-03-28 07:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 470528fa-a731-5129-a3ef-9e244f608ff2 with identifier: CX80626
2026-03-28 07:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 470528fa-a731-5129-a3ef-9e244f608ff2 with identifier: CX80626
2026-03-28 07:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 470528fa-a731-5129-a3ef-9e244f608ff2 with identifier: CX80626 to the API
2026-03-28 07:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:45:01Z',
'fuel_type': 'petrol',
'id': '470528fa-a731-5129-a3ef-9e244f608ff2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX80626',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 5342,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-02-17',
'seller_name': None,
'title': 'Skoda Fabia 1.0 TSI Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2025}
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX80626%27 HTTP/1.1" 200 None
2026-03-28 07:37:24 [auto1.de] INFO: Saving data for CX80626: {'auction_closing_time': 1774716301.0, 'created_time': 1774465843.905256, 'last_price_update_time': 1774683444.010914}
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX80626') HTTP/1.1" 204 0
2026-03-28 07:37:24 [auto1.de] INFO: Found listing with ID: MX24097
2026-03-28 07:37:24 [auto1.de] INFO: Found listing with ID: SP79691
2026-03-28 07:37:24 [auto1.de] INFO: Found listing with ID: LU60211
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU60211%27 HTTP/1.1" 200 None
2026-03-28 07:37:24 [auto1.de] INFO: Scrape type for LU60211: 2
2026-03-28 07:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56baaa45-1a0e-520e-b3af-49ae7ec21511 with identifier: LU60211
2026-03-28 07:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56baaa45-1a0e-520e-b3af-49ae7ec21511 with scrape type 2
2026-03-28 07:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56baaa45-1a0e-520e-b3af-49ae7ec21511 with scrape type 2
2026-03-28 07:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56baaa45-1a0e-520e-b3af-49ae7ec21511, identifier: LU60211
2026-03-28 07:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56baaa45-1a0e-520e-b3af-49ae7ec21511 with identifier: LU60211
2026-03-28 07:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56baaa45-1a0e-520e-b3af-49ae7ec21511 with identifier: LU60211
2026-03-28 07:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56baaa45-1a0e-520e-b3af-49ae7ec21511 with identifier: LU60211 to the API
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:04:23Z',
'fuel_type': 'petrol',
'id': '56baaa45-1a0e-520e-b3af-49ae7ec21511',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU60211',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 62184,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-01',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.5 TSI ACT Comfortline BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion',
'year': 2019}
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU60211%27 HTTP/1.1" 200 None
2026-03-28 07:37:24 [auto1.de] INFO: Saving data for LU60211: {'auction_closing_time': 1774713863.0, 'created_time': 1774466678.085338, 'last_price_update_time': 1774683444.53419}
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU60211') HTTP/1.1" 204 0
2026-03-28 07:37:24 [auto1.de] INFO: Found listing with ID: YZ03964
2026-03-28 07:37:24 [auto1.de] INFO: Found listing with ID: GF01666
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF01666%27 HTTP/1.1" 200 None
2026-03-28 07:37:24 [auto1.de] INFO: Scrape type for GF01666: 0
2026-03-28 07:37:24 [auto1.de] INFO: Found listing with ID: ED91782
2026-03-28 07:37:24 [auto1.de] INFO: Found listing with ID: DL96803
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL96803%27 HTTP/1.1" 200 None
2026-03-28 07:37:24 [auto1.de] INFO: Scrape type for DL96803: 0
2026-03-28 07:37:24 [auto1.de] INFO: Found listing with ID: BB78660
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB78660%27 HTTP/1.1" 200 None
2026-03-28 07:37:24 [auto1.de] INFO: Scrape type for BB78660: 0
2026-03-28 07:37:24 [auto1.de] INFO: Found listing with ID: KA83204
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83204%27 HTTP/1.1" 200 None
2026-03-28 07:37:24 [auto1.de] INFO: Scrape type for KA83204: 0
2026-03-28 07:37:24 [auto1.de] INFO: Found listing with ID: DK56258
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK56258%27 HTTP/1.1" 200 None
2026-03-28 07:37:24 [auto1.de] INFO: Scrape type for DK56258: 0
2026-03-28 07:37:24 [auto1.de] INFO: Found listing with ID: EH49621
2026-03-28 07:37:24 [auto1.de] INFO: Found listing with ID: SC73852
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC73852%27 HTTP/1.1" 200 None
2026-03-28 07:37:24 [auto1.de] INFO: Scrape type for SC73852: 0
2026-03-28 07:37:24 [auto1.de] INFO: Found listing with ID: YT14311
2026-03-28 07:37:24 [auto1.de] INFO: Found listing with ID: JG51855
2026-03-28 07:37:24 [auto1.de] INFO: Found listing with ID: CN22561
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN22561%27 HTTP/1.1" 200 None
2026-03-28 07:37:24 [auto1.de] INFO: Scrape type for CN22561: 0
2026-03-28 07:37:24 [auto1.de] INFO: Found listing with ID: GU42707
2026-03-28 07:37:24 [auto1.de] INFO: Found listing with ID: KE65935
2026-03-28 07:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:37:25 [auto1.de] INFO: Channel: 24h | Page: 87 | totalHits: 9256 | hits on page: 40
2026-03-28 07:37:25 [auto1.de] INFO: Found listing with ID: BP81382
2026-03-28 07:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP81382%27 HTTP/1.1" 200 None
2026-03-28 07:37:25 [auto1.de] INFO: Scrape type for BP81382: 0
2026-03-28 07:37:25 [auto1.de] INFO: Found listing with ID: CN22310
2026-03-28 07:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN22310%27 HTTP/1.1" 200 None
2026-03-28 07:37:25 [auto1.de] INFO: Scrape type for CN22310: 2
2026-03-28 07:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71e3afa4-78c9-5a28-bd35-e3cccf2296f8 with identifier: CN22310
2026-03-28 07:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71e3afa4-78c9-5a28-bd35-e3cccf2296f8 with scrape type 2
2026-03-28 07:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71e3afa4-78c9-5a28-bd35-e3cccf2296f8 with scrape type 2
2026-03-28 07:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71e3afa4-78c9-5a28-bd35-e3cccf2296f8, identifier: CN22310
2026-03-28 07:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71e3afa4-78c9-5a28-bd35-e3cccf2296f8 with identifier: CN22310
2026-03-28 07:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71e3afa4-78c9-5a28-bd35-e3cccf2296f8 with identifier: CN22310
2026-03-28 07:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71e3afa4-78c9-5a28-bd35-e3cccf2296f8 with identifier: CN22310 to the API
2026-03-28 07:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 160,
'expiration_date': '2026-03-28T16:13:51Z',
'fuel_type': 'petrol',
'id': '71e3afa4-78c9-5a28-bd35-e3cccf2296f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN22310',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 117781,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-05',
'seller_name': None,
'title': 'Volkswagen Passat 1.4 TSI Comfortline BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion',
'year': 2014}
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN22310%27 HTTP/1.1" 200 None
2026-03-28 07:37:26 [auto1.de] INFO: Saving data for CN22310: {'auction_closing_time': 1774714431.0, 'created_time': 1774466445.330466, 'last_price_update_time': 1774683446.302553}
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN22310') HTTP/1.1" 204 0
2026-03-28 07:37:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:37:26 [auto1.de] INFO: Found listing with ID: HZ13557
2026-03-28 07:37:26 [auto1.de] INFO: Found listing with ID: HU80433
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU80433%27 HTTP/1.1" 200 None
2026-03-28 07:37:26 [auto1.de] INFO: Scrape type for HU80433: 0
2026-03-28 07:37:26 [auto1.de] INFO: Found listing with ID: MG35847
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG35847%27 HTTP/1.1" 200 None
2026-03-28 07:37:26 [auto1.de] INFO: Scrape type for MG35847: 2
2026-03-28 07:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc6d7933-b897-547f-b744-472a68f4ec3f with identifier: MG35847
2026-03-28 07:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc6d7933-b897-547f-b744-472a68f4ec3f with scrape type 2
2026-03-28 07:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc6d7933-b897-547f-b744-472a68f4ec3f with scrape type 2
2026-03-28 07:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc6d7933-b897-547f-b744-472a68f4ec3f, identifier: MG35847
2026-03-28 07:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc6d7933-b897-547f-b744-472a68f4ec3f with identifier: MG35847
2026-03-28 07:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc6d7933-b897-547f-b744-472a68f4ec3f with identifier: MG35847
2026-03-28 07:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc6d7933-b897-547f-b744-472a68f4ec3f with identifier: MG35847 to the API
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 265,
'expiration_date': '2026-03-28T16:30:23Z',
'fuel_type': 'hybrid',
'id': 'dc6d7933-b897-547f-b744-472a68f4ec3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG35847',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 55534,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-19',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 T-GDI Plug-in Hybrid Prime 4WD',
'transmission': 'automatic',
'trim': 'Prime 4WD',
'year': 2021}
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG35847%27 HTTP/1.1" 200 None
2026-03-28 07:37:26 [auto1.de] INFO: Saving data for MG35847: {'auction_closing_time': 1774715423.0, 'created_time': 1774467736.367387, 'last_price_update_time': 1774683446.813222}
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG35847') HTTP/1.1" 204 0
2026-03-28 07:37:26 [auto1.de] INFO: Found listing with ID: FH31570
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH31570%27 HTTP/1.1" 200 None
2026-03-28 07:37:26 [auto1.de] INFO: Scrape type for FH31570: 0
2026-03-28 07:37:26 [auto1.de] INFO: Found listing with ID: ZB54249
2026-03-28 07:37:26 [auto1.de] INFO: Found listing with ID: AK76136
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK76136%27 HTTP/1.1" 200 None
2026-03-28 07:37:26 [auto1.de] INFO: Scrape type for AK76136: 0
2026-03-28 07:37:26 [auto1.de] INFO: Found listing with ID: SW71463
2026-03-28 07:37:26 [auto1.de] INFO: Found listing with ID: HT70874
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT70874%27 HTTP/1.1" 200 None
2026-03-28 07:37:26 [auto1.de] INFO: Scrape type for HT70874: 0
2026-03-28 07:37:26 [auto1.de] INFO: Found listing with ID: NW77024
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW77024%27 HTTP/1.1" 200 None
2026-03-28 07:37:26 [auto1.de] INFO: Scrape type for NW77024: 0
2026-03-28 07:37:26 [auto1.de] INFO: Found listing with ID: NU50542
2026-03-28 07:37:26 [auto1.de] INFO: Found listing with ID: EP25363
2026-03-28 07:37:26 [auto1.de] INFO: Found listing with ID: CL49552
2026-03-28 07:37:26 [auto1.de] INFO: Found listing with ID: EW37787
2026-03-28 07:37:26 [auto1.de] INFO: Found listing with ID: MP85459
2026-03-28 07:37:26 [auto1.de] INFO: Found listing with ID: JY72572
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY72572%27 HTTP/1.1" 200 None
2026-03-28 07:37:26 [auto1.de] INFO: Scrape type for JY72572: 2
2026-03-28 07:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4925d003-dd42-55b5-b308-c6cbbce4e813 with identifier: JY72572
2026-03-28 07:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4925d003-dd42-55b5-b308-c6cbbce4e813 with scrape type 2
2026-03-28 07:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4925d003-dd42-55b5-b308-c6cbbce4e813 with scrape type 2
2026-03-28 07:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4925d003-dd42-55b5-b308-c6cbbce4e813, identifier: JY72572
2026-03-28 07:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4925d003-dd42-55b5-b308-c6cbbce4e813 with identifier: JY72572
2026-03-28 07:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4925d003-dd42-55b5-b308-c6cbbce4e813 with identifier: JY72572
2026-03-28 07:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4925d003-dd42-55b5-b308-c6cbbce4e813 with identifier: JY72572 to the API
2026-03-28 07:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:10:41Z',
'fuel_type': 'diesel',
'id': '4925d003-dd42-55b5-b308-c6cbbce4e813',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY72572',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 133882,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-27',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2012}
2026-03-28 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY72572%27 HTTP/1.1" 200 None
2026-03-28 07:37:27 [auto1.de] INFO: Saving data for JY72572: {'auction_closing_time': 1774714241.0, 'created_time': 1774468112.59346, 'last_price_update_time': 1774683447.701275}
2026-03-28 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY72572') HTTP/1.1" 204 0
2026-03-28 07:37:27 [auto1.de] INFO: Found listing with ID: NS16825
2026-03-28 07:37:27 [auto1.de] INFO: Found listing with ID: CV73879
2026-03-28 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV73879%27 HTTP/1.1" 200 None
2026-03-28 07:37:27 [auto1.de] INFO: Scrape type for CV73879: 0
2026-03-28 07:37:27 [auto1.de] INFO: Found listing with ID: DA23811
2026-03-28 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA23811%27 HTTP/1.1" 200 None
2026-03-28 07:37:27 [auto1.de] INFO: Scrape type for DA23811: 0
2026-03-28 07:37:27 [auto1.de] INFO: Found listing with ID: BV96832
2026-03-28 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96832%27 HTTP/1.1" 200 None
2026-03-28 07:37:27 [auto1.de] INFO: Scrape type for BV96832: 0
2026-03-28 07:37:27 [auto1.de] INFO: Found listing with ID: AH07700
2026-03-28 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH07700%27 HTTP/1.1" 200 None
2026-03-28 07:37:27 [auto1.de] INFO: Scrape type for AH07700: 0
2026-03-28 07:37:27 [auto1.de] INFO: Found listing with ID: LU05399
2026-03-28 07:37:27 [auto1.de] INFO: Found listing with ID: FJ74023
2026-03-28 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ74023%27 HTTP/1.1" 200 None
2026-03-28 07:37:27 [auto1.de] INFO: Scrape type for FJ74023: 0
2026-03-28 07:37:27 [auto1.de] INFO: Found listing with ID: NL55322
2026-03-28 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL55322%27 HTTP/1.1" 200 None
2026-03-28 07:37:27 [auto1.de] INFO: Scrape type for NL55322: 0
2026-03-28 07:37:27 [auto1.de] INFO: Found listing with ID: FY04572
2026-03-28 07:37:27 [auto1.de] INFO: Found listing with ID: VX06445
2026-03-28 07:37:27 [auto1.de] INFO: Found listing with ID: GC35405
2026-03-28 07:37:27 [auto1.de] INFO: Found listing with ID: JJ29192
2026-03-28 07:37:27 [auto1.de] INFO: Found listing with ID: XM28055
2026-03-28 07:37:27 [auto1.de] INFO: Found listing with ID: SZ44736
2026-03-28 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ44736%27 HTTP/1.1" 200 None
2026-03-28 07:37:27 [auto1.de] INFO: Scrape type for SZ44736: 2
2026-03-28 07:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 183eaddc-94a9-5ca6-a138-d3a7d0d7392e with identifier: SZ44736
2026-03-28 07:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 183eaddc-94a9-5ca6-a138-d3a7d0d7392e with scrape type 2
2026-03-28 07:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 183eaddc-94a9-5ca6-a138-d3a7d0d7392e with scrape type 2
2026-03-28 07:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 183eaddc-94a9-5ca6-a138-d3a7d0d7392e, identifier: SZ44736
2026-03-28 07:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 183eaddc-94a9-5ca6-a138-d3a7d0d7392e with identifier: SZ44736
2026-03-28 07:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 183eaddc-94a9-5ca6-a138-d3a7d0d7392e with identifier: SZ44736
2026-03-28 07:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 183eaddc-94a9-5ca6-a138-d3a7d0d7392e with identifier: SZ44736 to the API
2026-03-28 07:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:16:56Z',
'fuel_type': 'diesel',
'id': '183eaddc-94a9-5ca6-a138-d3a7d0d7392e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ44736',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 120426,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-01',
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2018}
2026-03-28 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ44736%27 HTTP/1.1" 200 None
2026-03-28 07:37:28 [auto1.de] INFO: Saving data for SZ44736: {'auction_closing_time': 1774714616.0, 'created_time': 1774466882.465429, 'last_price_update_time': 1774683448.714716}
2026-03-28 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ44736') HTTP/1.1" 204 0
2026-03-28 07:37:28 [auto1.de] INFO: Found listing with ID: TE88755
2026-03-28 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE88755%27 HTTP/1.1" 200 None
2026-03-28 07:37:28 [auto1.de] INFO: Scrape type for TE88755: 0
2026-03-28 07:37:28 [auto1.de] INFO: Found listing with ID: XM44045
2026-03-28 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM44045%27 HTTP/1.1" 200 None
2026-03-28 07:37:28 [auto1.de] INFO: Scrape type for XM44045: 0
2026-03-28 07:37:28 [auto1.de] INFO: Found listing with ID: RB89503
2026-03-28 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB89503%27 HTTP/1.1" 200 None
2026-03-28 07:37:28 [auto1.de] INFO: Scrape type for RB89503: 0
2026-03-28 07:37:28 [auto1.de] INFO: Found listing with ID: SL38936
2026-03-28 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL38936%27 HTTP/1.1" 200 None
2026-03-28 07:37:28 [auto1.de] INFO: Scrape type for SL38936: 0
2026-03-28 07:37:28 [auto1.de] INFO: Found listing with ID: XT91085
2026-03-28 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91085%27 HTTP/1.1" 200 None
2026-03-28 07:37:28 [auto1.de] INFO: Scrape type for XT91085: 2
2026-03-28 07:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7138564-95f6-5414-b8e4-0075656b9eb8 with identifier: XT91085
2026-03-28 07:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7138564-95f6-5414-b8e4-0075656b9eb8 with scrape type 2
2026-03-28 07:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7138564-95f6-5414-b8e4-0075656b9eb8 with scrape type 2
2026-03-28 07:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7138564-95f6-5414-b8e4-0075656b9eb8, identifier: XT91085
2026-03-28 07:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7138564-95f6-5414-b8e4-0075656b9eb8 with identifier: XT91085
2026-03-28 07:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7138564-95f6-5414-b8e4-0075656b9eb8 with identifier: XT91085
2026-03-28 07:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7138564-95f6-5414-b8e4-0075656b9eb8 with identifier: XT91085 to the API
2026-03-28 07:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-28T16:21:43Z',
'fuel_type': 'petrol',
'id': 'e7138564-95f6-5414-b8e4-0075656b9eb8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT91085',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 175770,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-11-29',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 Kompressor T BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'T BlueEfficiency Avantgarde',
'year': 2009}
2026-03-28 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91085%27 HTTP/1.1" 200 None
2026-03-28 07:37:30 [auto1.de] INFO: Saving data for XT91085: {'auction_closing_time': 1774714903.0, 'created_time': 1774465294.798232, 'last_price_update_time': 1774683450.005461}
2026-03-28 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT91085') HTTP/1.1" 204 0
2026-03-28 07:37:30 [auto1.de] INFO: Found listing with ID: XJ41325
2026-03-28 07:37:30 [auto1.de] INFO: Found listing with ID: ND84220
2026-03-28 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND84220%27 HTTP/1.1" 200 None
2026-03-28 07:37:30 [auto1.de] INFO: Scrape type for ND84220: 0
2026-03-28 07:37:30 [auto1.de] INFO: Found listing with ID: SW03993
2026-03-28 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW03993%27 HTTP/1.1" 200 None
2026-03-28 07:37:30 [auto1.de] INFO: Scrape type for SW03993: 0
2026-03-28 07:37:30 [auto1.de] INFO: Found listing with ID: SL19665
2026-03-28 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL19665%27 HTTP/1.1" 200 None
2026-03-28 07:37:30 [auto1.de] INFO: Scrape type for SL19665: 0
2026-03-28 07:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:37:31 [auto1.de] INFO: Channel: 24h | Page: 88 | totalHits: 9256 | hits on page: 40
2026-03-28 07:37:31 [auto1.de] INFO: Found listing with ID: MT39473
2026-03-28 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT39473%27 HTTP/1.1" 200 None
2026-03-28 07:37:31 [auto1.de] INFO: Scrape type for MT39473: 0
2026-03-28 07:37:31 [auto1.de] INFO: Found listing with ID: SV83384
2026-03-28 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV83384%27 HTTP/1.1" 200 None
2026-03-28 07:37:31 [auto1.de] INFO: Scrape type for SV83384: 0
2026-03-28 07:37:31 [auto1.de] INFO: Found listing with ID: HN26382
2026-03-28 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN26382%27 HTTP/1.1" 200 None
2026-03-28 07:37:31 [auto1.de] INFO: Scrape type for HN26382: 0
2026-03-28 07:37:31 [auto1.de] INFO: Found listing with ID: HT62005
2026-03-28 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT62005%27 HTTP/1.1" 200 None
2026-03-28 07:37:31 [auto1.de] INFO: Scrape type for HT62005: 0
2026-03-28 07:37:31 [auto1.de] INFO: Found listing with ID: AL74517
2026-03-28 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL74517%27 HTTP/1.1" 200 None
2026-03-28 07:37:31 [auto1.de] INFO: Scrape type for AL74517: 0
2026-03-28 07:37:31 [auto1.de] INFO: Found listing with ID: RJ03862
2026-03-28 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ03862%27 HTTP/1.1" 200 None
2026-03-28 07:37:31 [auto1.de] INFO: Scrape type for RJ03862: 0
2026-03-28 07:37:31 [auto1.de] INFO: Found listing with ID: RB22775
2026-03-28 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB22775%27 HTTP/1.1" 200 None
2026-03-28 07:37:31 [auto1.de] INFO: Scrape type for RB22775: 2
2026-03-28 07:37:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f3a81a7-013a-5c20-9898-18d2fb5e88bd with identifier: RB22775
2026-03-28 07:37:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f3a81a7-013a-5c20-9898-18d2fb5e88bd with scrape type 2
2026-03-28 07:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f3a81a7-013a-5c20-9898-18d2fb5e88bd with scrape type 2
2026-03-28 07:37:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f3a81a7-013a-5c20-9898-18d2fb5e88bd, identifier: RB22775
2026-03-28 07:37:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f3a81a7-013a-5c20-9898-18d2fb5e88bd with identifier: RB22775
2026-03-28 07:37:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f3a81a7-013a-5c20-9898-18d2fb5e88bd with identifier: RB22775
2026-03-28 07:37:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f3a81a7-013a-5c20-9898-18d2fb5e88bd with identifier: RB22775 to the API
2026-03-28 07:37:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 510,
'expiration_date': '2026-03-28T16:46:15Z',
'fuel_type': 'petrol',
'id': '6f3a81a7-013a-5c20-9898-18d2fb5e88bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB22775',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 151617,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-26',
'seller_name': None,
'title': 'Land Rover Range Rover 5.0 V8 Autobiography',
'transmission': 'automatic',
'trim': 'Autobiography',
'year': 2017}
2026-03-28 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB22775%27 HTTP/1.1" 200 None
2026-03-28 07:37:32 [auto1.de] INFO: Saving data for RB22775: {'auction_closing_time': 1774716375.0, 'created_time': 1774468118.175736, 'last_price_update_time': 1774683452.715894}
2026-03-28 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB22775') HTTP/1.1" 204 0
2026-03-28 07:37:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:37:32 [auto1.de] INFO: Found listing with ID: VS05622
2026-03-28 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS05622%27 HTTP/1.1" 200 None
2026-03-28 07:37:32 [auto1.de] INFO: Scrape type for VS05622: 0
2026-03-28 07:37:32 [auto1.de] INFO: Found listing with ID: DF48310
2026-03-28 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF48310%27 HTTP/1.1" 200 None
2026-03-28 07:37:32 [auto1.de] INFO: Scrape type for DF48310: 2
2026-03-28 07:37:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eafbd813-8adb-56a6-8715-2e4ad988ce4a with identifier: DF48310
2026-03-28 07:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eafbd813-8adb-56a6-8715-2e4ad988ce4a with scrape type 2
2026-03-28 07:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eafbd813-8adb-56a6-8715-2e4ad988ce4a with scrape type 2
2026-03-28 07:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eafbd813-8adb-56a6-8715-2e4ad988ce4a, identifier: DF48310
2026-03-28 07:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eafbd813-8adb-56a6-8715-2e4ad988ce4a with identifier: DF48310
2026-03-28 07:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eafbd813-8adb-56a6-8715-2e4ad988ce4a with identifier: DF48310
2026-03-28 07:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eafbd813-8adb-56a6-8715-2e4ad988ce4a with identifier: DF48310 to the API
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 260,
'expiration_date': '2026-03-28T16:01:18Z',
'fuel_type': 'petrol',
'id': 'eafbd813-8adb-56a6-8715-2e4ad988ce4a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF48310',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia',
'odometer': 96788,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-19',
'seller_name': None,
'title': 'Opel Insignia 2.8 V6 Turbo Sport 4x4',
'transmission': 'manual',
'trim': 'Sport 4x4',
'year': 2011}
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF48310%27 HTTP/1.1" 200 None
2026-03-28 07:37:33 [auto1.de] INFO: Saving data for DF48310: {'auction_closing_time': 1774713678.0, 'created_time': 1774465748.560091, 'last_price_update_time': 1774683453.320684}
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF48310') HTTP/1.1" 204 0
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: FD93722
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: YY19012
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY19012%27 HTTP/1.1" 200 None
2026-03-28 07:37:33 [auto1.de] INFO: Scrape type for YY19012: 0
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: ZZ01082
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: DC51823
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: LD78025
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: BG13835
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG13835%27 HTTP/1.1" 200 None
2026-03-28 07:37:33 [auto1.de] INFO: Scrape type for BG13835: 0
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: AB33949
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB33949%27 HTTP/1.1" 200 None
2026-03-28 07:37:33 [auto1.de] INFO: Scrape type for AB33949: 2
2026-03-28 07:37:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85b9cc43-4f86-5c04-b65d-2f149a818282 with identifier: AB33949
2026-03-28 07:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85b9cc43-4f86-5c04-b65d-2f149a818282 with scrape type 2
2026-03-28 07:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85b9cc43-4f86-5c04-b65d-2f149a818282 with scrape type 2
2026-03-28 07:37:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85b9cc43-4f86-5c04-b65d-2f149a818282, identifier: AB33949
2026-03-28 07:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85b9cc43-4f86-5c04-b65d-2f149a818282 with identifier: AB33949
2026-03-28 07:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85b9cc43-4f86-5c04-b65d-2f149a818282 with identifier: AB33949
2026-03-28 07:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85b9cc43-4f86-5c04-b65d-2f149a818282 with identifier: AB33949 to the API
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 290,
'expiration_date': '2026-03-28T16:23:55Z',
'fuel_type': 'petrol',
'id': '85b9cc43-4f86-5c04-b65d-2f149a818282',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB33949',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 184691,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-25',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2010}
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB33949%27 HTTP/1.1" 200 None
2026-03-28 07:37:33 [auto1.de] INFO: Saving data for AB33949: {'auction_closing_time': 1774715035.0, 'created_time': 1774032328.574124, 'last_price_update_time': 1774683453.837599}
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB33949') HTTP/1.1" 204 0
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: NS90051
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: BR94807
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: SD77911
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD77911%27 HTTP/1.1" 200 None
2026-03-28 07:37:33 [auto1.de] INFO: Scrape type for SD77911: 0
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: HK07166
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK07166%27 HTTP/1.1" 200 None
2026-03-28 07:37:33 [auto1.de] INFO: Scrape type for HK07166: 0
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: AE50962
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE50962%27 HTTP/1.1" 200 None
2026-03-28 07:37:33 [auto1.de] INFO: Scrape type for AE50962: 0
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: NZ25875
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: HC88789
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: WZ27429
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: PA10623
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA10623%27 HTTP/1.1" 200 None
2026-03-28 07:37:33 [auto1.de] INFO: Scrape type for PA10623: 0
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: NP12620
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP12620%27 HTTP/1.1" 200 None
2026-03-28 07:37:33 [auto1.de] INFO: Scrape type for NP12620: 0
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: NA24630
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: ZC43990
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: VC66912
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC66912%27 HTTP/1.1" 200 None
2026-03-28 07:37:33 [auto1.de] INFO: Scrape type for VC66912: 0
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: TD00729
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD00729%27 HTTP/1.1" 200 None
2026-03-28 07:37:33 [auto1.de] INFO: Scrape type for TD00729: 0
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: LD57431
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: ZY80421
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: FZ35057
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: SJ63454
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: PP58013
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: GG43285
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: RX33159
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: XP95900
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP95900%27 HTTP/1.1" 200 None
2026-03-28 07:37:33 [auto1.de] INFO: Scrape type for XP95900: 0
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: PN00069
2026-03-28 07:37:33 [auto1.de] INFO: Found listing with ID: RA28686
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA28686%27 HTTP/1.1" 200 None
2026-03-28 07:37:33 [auto1.de] INFO: Scrape type for RA28686: 0
2026-03-28 07:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:37:41 [auto1.de] INFO: Channel: 24h | Page: 89 | totalHits: 9257 | hits on page: 40
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: RA28686
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA28686%27 HTTP/1.1" 200 None
2026-03-28 07:37:41 [auto1.de] INFO: Scrape type for RA28686: 0
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: AY74749
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: JN73492
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: UY94475
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: SX50197
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: HY42291
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: WP34180
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: WA46959
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: MH83701
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH83701%27 HTTP/1.1" 200 None
2026-03-28 07:37:41 [auto1.de] INFO: Scrape type for MH83701: 0
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: VV35876
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: WJ73657
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ73657%27 HTTP/1.1" 200 None
2026-03-28 07:37:41 [auto1.de] INFO: Scrape type for WJ73657: 0
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: EH05548
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: ZG14470
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14470%27 HTTP/1.1" 200 None
2026-03-28 07:37:41 [auto1.de] INFO: Scrape type for ZG14470: 0
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: UA33739
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: VN96863
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN96863%27 HTTP/1.1" 200 None
2026-03-28 07:37:41 [auto1.de] INFO: Scrape type for VN96863: 0
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: AN16579
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN16579%27 HTTP/1.1" 200 None
2026-03-28 07:37:41 [auto1.de] INFO: Scrape type for AN16579: 0
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: FX77489
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: BL86865
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL86865%27 HTTP/1.1" 200 None
2026-03-28 07:37:41 [auto1.de] INFO: Scrape type for BL86865: 0
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: MC04391
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC04391%27 HTTP/1.1" 200 None
2026-03-28 07:37:41 [auto1.de] INFO: Scrape type for MC04391: 0
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: SB28206
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: FK23500
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: HR99158
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR99158%27 HTTP/1.1" 200 None
2026-03-28 07:37:41 [auto1.de] INFO: Scrape type for HR99158: 0
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: HY86490
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: WJ35456
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: XS00144
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: UN73859
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN73859%27 HTTP/1.1" 200 None
2026-03-28 07:37:41 [auto1.de] INFO: Scrape type for UN73859: 0
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: AT81603
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT81603%27 HTTP/1.1" 200 None
2026-03-28 07:37:41 [auto1.de] INFO: Scrape type for AT81603: 0
2026-03-28 07:37:41 [auto1.de] INFO: Found listing with ID: EX72075
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX72075%27 HTTP/1.1" 200 None
2026-03-28 07:37:41 [auto1.de] INFO: Scrape type for EX72075: 2
2026-03-28 07:37:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea1bebfb-5a51-5f8b-9ae6-13f931313fd4 with identifier: EX72075
2026-03-28 07:37:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea1bebfb-5a51-5f8b-9ae6-13f931313fd4 with scrape type 2
2026-03-28 07:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea1bebfb-5a51-5f8b-9ae6-13f931313fd4 with scrape type 2
2026-03-28 07:37:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea1bebfb-5a51-5f8b-9ae6-13f931313fd4, identifier: EX72075
2026-03-28 07:37:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea1bebfb-5a51-5f8b-9ae6-13f931313fd4 with identifier: EX72075
2026-03-28 07:37:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea1bebfb-5a51-5f8b-9ae6-13f931313fd4 with identifier: EX72075
2026-03-28 07:37:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea1bebfb-5a51-5f8b-9ae6-13f931313fd4 with identifier: EX72075 to the API
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 340,
'expiration_date': '2026-03-28T16:19:27Z',
'fuel_type': 'petrol',
'id': 'ea1bebfb-5a51-5f8b-9ae6-13f931313fd4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX72075',
'listing': 'auction',
'make': 'BMW',
'model': 'Z4',
'odometer': 50597,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-14',
'seller_name': None,
'title': 'BMW Z4 M40i',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-03-28 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX72075%27 HTTP/1.1" 200 None
2026-03-28 07:37:42 [auto1.de] INFO: Saving data for EX72075: {'auction_closing_time': 1774714767.0, 'created_time': 1774465611.021806, 'last_price_update_time': 1774683462.069577}
2026-03-28 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX72075') HTTP/1.1" 204 0
2026-03-28 07:37:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:37:42 [auto1.de] INFO: Found listing with ID: FV97626
2026-03-28 07:37:42 [auto1.de] INFO: Found listing with ID: RB55254
2026-03-28 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB55254%27 HTTP/1.1" 200 None
2026-03-28 07:37:42 [auto1.de] INFO: Scrape type for RB55254: 0
2026-03-28 07:37:42 [auto1.de] INFO: Found listing with ID: LT89703
2026-03-28 07:37:42 [auto1.de] INFO: Found listing with ID: FC82550
2026-03-28 07:37:42 [auto1.de] INFO: Found listing with ID: MF75644
2026-03-28 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF75644%27 HTTP/1.1" 200 None
2026-03-28 07:37:42 [auto1.de] INFO: Scrape type for MF75644: 0
2026-03-28 07:37:42 [auto1.de] INFO: Found listing with ID: PF15071
2026-03-28 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF15071%27 HTTP/1.1" 200 None
2026-03-28 07:37:42 [auto1.de] INFO: Scrape type for PF15071: 0
2026-03-28 07:37:42 [auto1.de] INFO: Found listing with ID: RL59137
2026-03-28 07:37:42 [auto1.de] INFO: Found listing with ID: WG72441
2026-03-28 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG72441%27 HTTP/1.1" 200 None
2026-03-28 07:37:42 [auto1.de] INFO: Scrape type for WG72441: 0
2026-03-28 07:37:42 [auto1.de] INFO: Found listing with ID: AZ18369
2026-03-28 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ18369%27 HTTP/1.1" 200 None
2026-03-28 07:37:42 [auto1.de] INFO: Scrape type for AZ18369: 0
2026-03-28 07:37:42 [auto1.de] INFO: Found listing with ID: LC91411
2026-03-28 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91411%27 HTTP/1.1" 200 None
2026-03-28 07:37:42 [auto1.de] INFO: Scrape type for LC91411: 0
2026-03-28 07:37:42 [auto1.de] INFO: Found listing with ID: MJ34390
2026-03-28 07:37:42 [auto1.de] INFO: Found listing with ID: ZJ64916
2026-03-28 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ64916%27 HTTP/1.1" 200 None
2026-03-28 07:37:42 [auto1.de] INFO: Scrape type for ZJ64916: 0
2026-03-28 07:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:37:43 [auto1.de] INFO: Channel: 24h | Page: 90 | totalHits: 9257 | hits on page: 40
2026-03-28 07:37:43 [auto1.de] INFO: Found listing with ID: AD21201
2026-03-28 07:37:43 [auto1.de] INFO: Found listing with ID: LC00841
2026-03-28 07:37:43 [auto1.de] INFO: Found listing with ID: WX56329
2026-03-28 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX56329%27 HTTP/1.1" 200 None
2026-03-28 07:37:44 [auto1.de] INFO: Scrape type for WX56329: 0
2026-03-28 07:37:44 [auto1.de] INFO: Found listing with ID: CN56098
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN56098%27 HTTP/1.1" 200 None
2026-03-28 07:37:44 [auto1.de] INFO: Scrape type for CN56098: 0
2026-03-28 07:37:44 [auto1.de] INFO: Found listing with ID: DS97225
2026-03-28 07:37:44 [auto1.de] INFO: Found listing with ID: MK09620
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK09620%27 HTTP/1.1" 200 None
2026-03-28 07:37:44 [auto1.de] INFO: Scrape type for MK09620: 0
2026-03-28 07:37:44 [auto1.de] INFO: Found listing with ID: MH41234
2026-03-28 07:37:44 [auto1.de] INFO: Found listing with ID: AG42574
2026-03-28 07:37:44 [auto1.de] INFO: Found listing with ID: WA53567
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA53567%27 HTTP/1.1" 200 None
2026-03-28 07:37:44 [auto1.de] INFO: Scrape type for WA53567: 0
2026-03-28 07:37:44 [auto1.de] INFO: Found listing with ID: VV73959
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV73959%27 HTTP/1.1" 200 None
2026-03-28 07:37:44 [auto1.de] INFO: Scrape type for VV73959: 0
2026-03-28 07:37:44 [auto1.de] INFO: Found listing with ID: SF44435
2026-03-28 07:37:44 [auto1.de] INFO: Found listing with ID: YA96951
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA96951%27 HTTP/1.1" 200 None
2026-03-28 07:37:44 [auto1.de] INFO: Scrape type for YA96951: 2
2026-03-28 07:37:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 384704b3-7420-5304-9162-f1a0c09b7667 with identifier: YA96951
2026-03-28 07:37:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 384704b3-7420-5304-9162-f1a0c09b7667 with scrape type 2
2026-03-28 07:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 384704b3-7420-5304-9162-f1a0c09b7667 with scrape type 2
2026-03-28 07:37:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 384704b3-7420-5304-9162-f1a0c09b7667, identifier: YA96951
2026-03-28 07:37:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 384704b3-7420-5304-9162-f1a0c09b7667 with identifier: YA96951
2026-03-28 07:37:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 384704b3-7420-5304-9162-f1a0c09b7667 with identifier: YA96951
2026-03-28 07:37:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 384704b3-7420-5304-9162-f1a0c09b7667 with identifier: YA96951 to the API
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:29:35Z',
'fuel_type': 'diesel',
'id': '384704b3-7420-5304-9162-f1a0c09b7667',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA96951',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 165801,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-15',
'seller_name': None,
'title': 'Citroen C4 1.6 HDi Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2010}
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA96951%27 HTTP/1.1" 200 None
2026-03-28 07:37:44 [auto1.de] INFO: Saving data for YA96951: {'auction_closing_time': 1774715375.0, 'created_time': 1773830513.201174, 'last_price_update_time': 1774683464.54855}
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA96951') HTTP/1.1" 204 0
2026-03-28 07:37:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:37:44 [auto1.de] INFO: Found listing with ID: NC35073
2026-03-28 07:37:44 [auto1.de] INFO: Found listing with ID: VU78858
2026-03-28 07:37:44 [auto1.de] INFO: Found listing with ID: CB59188
2026-03-28 07:37:44 [auto1.de] INFO: Found listing with ID: CM96643
2026-03-28 07:37:44 [auto1.de] INFO: Found listing with ID: GE16975
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE16975%27 HTTP/1.1" 200 None
2026-03-28 07:37:44 [auto1.de] INFO: Scrape type for GE16975: 0
2026-03-28 07:37:44 [auto1.de] INFO: Found listing with ID: TY15640
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY15640%27 HTTP/1.1" 200 None
2026-03-28 07:37:44 [auto1.de] INFO: Scrape type for TY15640: 0
2026-03-28 07:37:44 [auto1.de] INFO: Found listing with ID: GX49972
2026-03-28 07:37:44 [auto1.de] INFO: Found listing with ID: KS96797
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS96797%27 HTTP/1.1" 200 None
2026-03-28 07:37:44 [auto1.de] INFO: Scrape type for KS96797: 0
2026-03-28 07:37:44 [auto1.de] INFO: Found listing with ID: SM55936
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM55936%27 HTTP/1.1" 200 None
2026-03-28 07:37:44 [auto1.de] INFO: Scrape type for SM55936: 0
2026-03-28 07:37:44 [auto1.de] INFO: Found listing with ID: DD53059
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD53059%27 HTTP/1.1" 200 None
2026-03-28 07:37:44 [auto1.de] INFO: Scrape type for DD53059: 2
2026-03-28 07:37:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5f29718-75ab-507e-a2f1-09f73682a4bd with identifier: DD53059
2026-03-28 07:37:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5f29718-75ab-507e-a2f1-09f73682a4bd with scrape type 2
2026-03-28 07:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5f29718-75ab-507e-a2f1-09f73682a4bd with scrape type 2
2026-03-28 07:37:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5f29718-75ab-507e-a2f1-09f73682a4bd, identifier: DD53059
2026-03-28 07:37:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5f29718-75ab-507e-a2f1-09f73682a4bd with identifier: DD53059
2026-03-28 07:37:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5f29718-75ab-507e-a2f1-09f73682a4bd with identifier: DD53059
2026-03-28 07:37:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5f29718-75ab-507e-a2f1-09f73682a4bd with identifier: DD53059 to the API
2026-03-28 07:37:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:20:14Z',
'fuel_type': 'petrol',
'id': 'f5f29718-75ab-507e-a2f1-09f73682a4bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD53059',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 101307,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-29',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2017}
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD53059%27 HTTP/1.1" 200 None
2026-03-28 07:37:45 [auto1.de] INFO: Saving data for DD53059: {'auction_closing_time': 1774714814.0, 'created_time': 1774463618.824813, 'last_price_update_time': 1774683465.140564}
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD53059') HTTP/1.1" 204 0
2026-03-28 07:37:45 [auto1.de] INFO: Found listing with ID: LU87387
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU87387%27 HTTP/1.1" 200 None
2026-03-28 07:37:45 [auto1.de] INFO: Scrape type for LU87387: 0
2026-03-28 07:37:45 [auto1.de] INFO: Found listing with ID: SZ17598
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ17598%27 HTTP/1.1" 200 None
2026-03-28 07:37:45 [auto1.de] INFO: Scrape type for SZ17598: 0
2026-03-28 07:37:45 [auto1.de] INFO: Found listing with ID: GG45079
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG45079%27 HTTP/1.1" 200 None
2026-03-28 07:37:45 [auto1.de] INFO: Scrape type for GG45079: 0
2026-03-28 07:37:45 [auto1.de] INFO: Found listing with ID: HB99974
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB99974%27 HTTP/1.1" 200 None
2026-03-28 07:37:45 [auto1.de] INFO: Scrape type for HB99974: 0
2026-03-28 07:37:45 [auto1.de] INFO: Found listing with ID: YZ97980
2026-03-28 07:37:45 [auto1.de] INFO: Found listing with ID: ZA48754
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA48754%27 HTTP/1.1" 200 None
2026-03-28 07:37:45 [auto1.de] INFO: Scrape type for ZA48754: 2
2026-03-28 07:37:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db018b84-135e-5b7a-826e-cf3bc2990fb1 with identifier: ZA48754
2026-03-28 07:37:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db018b84-135e-5b7a-826e-cf3bc2990fb1 with scrape type 2
2026-03-28 07:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db018b84-135e-5b7a-826e-cf3bc2990fb1 with scrape type 2
2026-03-28 07:37:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db018b84-135e-5b7a-826e-cf3bc2990fb1, identifier: ZA48754
2026-03-28 07:37:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db018b84-135e-5b7a-826e-cf3bc2990fb1 with identifier: ZA48754
2026-03-28 07:37:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db018b84-135e-5b7a-826e-cf3bc2990fb1 with identifier: ZA48754
2026-03-28 07:37:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db018b84-135e-5b7a-826e-cf3bc2990fb1 with identifier: ZA48754 to the API
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:12:03Z',
'fuel_type': 'petrol',
'id': 'db018b84-135e-5b7a-826e-cf3bc2990fb1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA48754',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira',
'odometer': 227465,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-07',
'seller_name': None,
'title': 'Opel Zafira 1.6 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2009}
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA48754%27 HTTP/1.1" 200 None
2026-03-28 07:37:45 [auto1.de] INFO: Saving data for ZA48754: {'auction_closing_time': 1774714323.0, 'created_time': 1774463797.221248, 'last_price_update_time': 1774683465.650163}
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA48754') HTTP/1.1" 204 0
2026-03-28 07:37:45 [auto1.de] INFO: Found listing with ID: RM29810
2026-03-28 07:37:45 [auto1.de] INFO: Found listing with ID: GA13082
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA13082%27 HTTP/1.1" 200 None
2026-03-28 07:37:45 [auto1.de] INFO: Scrape type for GA13082: 0
2026-03-28 07:37:45 [auto1.de] INFO: Found listing with ID: NM38216
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM38216%27 HTTP/1.1" 200 None
2026-03-28 07:37:45 [auto1.de] INFO: Scrape type for NM38216: 2
2026-03-28 07:37:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4aad1289-9445-5cf2-88a0-9f77b2f96e0e with identifier: NM38216
2026-03-28 07:37:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4aad1289-9445-5cf2-88a0-9f77b2f96e0e with scrape type 2
2026-03-28 07:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4aad1289-9445-5cf2-88a0-9f77b2f96e0e with scrape type 2
2026-03-28 07:37:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4aad1289-9445-5cf2-88a0-9f77b2f96e0e, identifier: NM38216
2026-03-28 07:37:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4aad1289-9445-5cf2-88a0-9f77b2f96e0e with identifier: NM38216
2026-03-28 07:37:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4aad1289-9445-5cf2-88a0-9f77b2f96e0e with identifier: NM38216
2026-03-28 07:37:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4aad1289-9445-5cf2-88a0-9f77b2f96e0e with identifier: NM38216 to the API
2026-03-28 07:37:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-28T16:31:57Z',
'fuel_type': 'petrol',
'id': '4aad1289-9445-5cf2-88a0-9f77b2f96e0e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM38216',
'listing': 'auction',
'make': 'Nissan',
'model': 'Micra',
'odometer': 54436,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-25',
'seller_name': None,
'title': 'Nissan Micra 1.2 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2016}
2026-03-28 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM38216%27 HTTP/1.1" 200 None
2026-03-28 07:37:46 [auto1.de] INFO: Saving data for NM38216: {'auction_closing_time': 1774715517.0, 'created_time': 1774465879.17738, 'last_price_update_time': 1774683466.217485}
2026-03-28 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NM38216') HTTP/1.1" 204 0
2026-03-28 07:37:46 [auto1.de] INFO: Found listing with ID: TN52823
2026-03-28 07:37:46 [auto1.de] INFO: Found listing with ID: FH96221
2026-03-28 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH96221%27 HTTP/1.1" 200 None
2026-03-28 07:37:46 [auto1.de] INFO: Scrape type for FH96221: 2
2026-03-28 07:37:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b3c72e6-2832-57d9-909e-c079264c3094 with identifier: FH96221
2026-03-28 07:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b3c72e6-2832-57d9-909e-c079264c3094 with scrape type 2
2026-03-28 07:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b3c72e6-2832-57d9-909e-c079264c3094 with scrape type 2
2026-03-28 07:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b3c72e6-2832-57d9-909e-c079264c3094, identifier: FH96221
2026-03-28 07:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b3c72e6-2832-57d9-909e-c079264c3094 with identifier: FH96221
2026-03-28 07:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b3c72e6-2832-57d9-909e-c079264c3094 with identifier: FH96221
2026-03-28 07:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b3c72e6-2832-57d9-909e-c079264c3094 with identifier: FH96221 to the API
2026-03-28 07:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:49:39Z',
'fuel_type': 'petrol',
'id': '2b3c72e6-2832-57d9-909e-c079264c3094',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH96221',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 137874,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-19',
'seller_name': None,
'title': 'BMW 5er 523i',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-28 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH96221%27 HTTP/1.1" 200 None
2026-03-28 07:37:46 [auto1.de] INFO: Saving data for FH96221: {'auction_closing_time': 1774716579.0, 'created_time': 1774463675.073143, 'last_price_update_time': 1774683466.659382}
2026-03-28 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH96221') HTTP/1.1" 204 0
2026-03-28 07:37:46 [auto1.de] INFO: Found listing with ID: FP09706
2026-03-28 07:37:46 [auto1.de] INFO: Found listing with ID: BX89684
2026-03-28 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX89684%27 HTTP/1.1" 200 None
2026-03-28 07:37:46 [auto1.de] INFO: Scrape type for BX89684: 0
2026-03-28 07:37:46 [auto1.de] INFO: Found listing with ID: BL21282
2026-03-28 07:37:46 [auto1.de] INFO: Found listing with ID: YA77480
2026-03-28 07:37:46 [auto1.de] INFO: Found listing with ID: PR94578
2026-03-28 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR94578%27 HTTP/1.1" 200 None
2026-03-28 07:37:46 [auto1.de] INFO: Scrape type for PR94578: 2
2026-03-28 07:37:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dd8baf7-a512-5c97-ad82-ad3980c13150 with identifier: PR94578
2026-03-28 07:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dd8baf7-a512-5c97-ad82-ad3980c13150 with scrape type 2
2026-03-28 07:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dd8baf7-a512-5c97-ad82-ad3980c13150 with scrape type 2
2026-03-28 07:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2dd8baf7-a512-5c97-ad82-ad3980c13150, identifier: PR94578
2026-03-28 07:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2dd8baf7-a512-5c97-ad82-ad3980c13150 with identifier: PR94578
2026-03-28 07:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2dd8baf7-a512-5c97-ad82-ad3980c13150 with identifier: PR94578
2026-03-28 07:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2dd8baf7-a512-5c97-ad82-ad3980c13150 with identifier: PR94578 to the API
2026-03-28 07:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 231,
'expiration_date': '2026-03-28T16:28:53Z',
'fuel_type': 'hybrid',
'id': '2dd8baf7-a512-5c97-ad82-ad3980c13150',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR94578',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 124548,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-16',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 300 Hybrid T BlueTEC Edition 1 Avantgarde',
'transmission': 'automatic',
'trim': 'T BlueTEC Edition 1 Avantgarde',
'year': 2015}
2026-03-28 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR94578%27 HTTP/1.1" 200 None
2026-03-28 07:37:47 [auto1.de] INFO: Saving data for PR94578: {'auction_closing_time': 1774715333.0, 'created_time': 1774468193.289395, 'last_price_update_time': 1774683467.099188}
2026-03-28 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR94578') HTTP/1.1" 204 0
2026-03-28 07:37:47 [auto1.de] INFO: Found listing with ID: ZL92656
2026-03-28 07:37:47 [auto1.de] INFO: Found listing with ID: ZN73895
2026-03-28 07:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:37:47 [auto1.de] INFO: Channel: 24h | Page: 91 | totalHits: 9257 | hits on page: 40
2026-03-28 07:37:47 [auto1.de] INFO: Found listing with ID: BU43780
2026-03-28 07:37:47 [auto1.de] INFO: Found listing with ID: LN26385
2026-03-28 07:37:47 [auto1.de] INFO: Found listing with ID: ZF95436
2026-03-28 07:37:47 [auto1.de] INFO: Found listing with ID: HA51828
2026-03-28 07:37:47 [auto1.de] INFO: Found listing with ID: XG30345
2026-03-28 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG30345%27 HTTP/1.1" 200 None
2026-03-28 07:37:47 [auto1.de] INFO: Scrape type for XG30345: 2
2026-03-28 07:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00f35286-d543-57dc-be90-805b00f92918 with identifier: XG30345
2026-03-28 07:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00f35286-d543-57dc-be90-805b00f92918 with scrape type 2
2026-03-28 07:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00f35286-d543-57dc-be90-805b00f92918 with scrape type 2
2026-03-28 07:37:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00f35286-d543-57dc-be90-805b00f92918, identifier: XG30345
2026-03-28 07:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00f35286-d543-57dc-be90-805b00f92918 with identifier: XG30345
2026-03-28 07:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00f35286-d543-57dc-be90-805b00f92918 with identifier: XG30345
2026-03-28 07:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00f35286-d543-57dc-be90-805b00f92918 with identifier: XG30345 to the API
2026-03-28 07:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:46:21Z',
'fuel_type': 'petrol',
'id': '00f35286-d543-57dc-be90-805b00f92918',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG30345',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Jimny',
'odometer': 86873,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-22',
'seller_name': None,
'title': 'Suzuki Jimny 1.3 Club',
'transmission': 'manual',
'trim': 'Club',
'year': 2011}
2026-03-28 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG30345%27 HTTP/1.1" 200 None
2026-03-28 07:37:47 [auto1.de] INFO: Saving data for XG30345: {'auction_closing_time': 1774716381.0, 'created_time': 1774468006.822355, 'last_price_update_time': 1774683467.961646}
2026-03-28 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG30345') HTTP/1.1" 204 0
2026-03-28 07:37:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:37:48 [auto1.de] INFO: Found listing with ID: HZ88582
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ88582%27 HTTP/1.1" 200 None
2026-03-28 07:37:48 [auto1.de] INFO: Scrape type for HZ88582: 0
2026-03-28 07:37:48 [auto1.de] INFO: Found listing with ID: FU29897
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU29897%27 HTTP/1.1" 200 None
2026-03-28 07:37:48 [auto1.de] INFO: Scrape type for FU29897: 0
2026-03-28 07:37:48 [auto1.de] INFO: Found listing with ID: HR47989
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR47989%27 HTTP/1.1" 200 None
2026-03-28 07:37:48 [auto1.de] INFO: Scrape type for HR47989: 0
2026-03-28 07:37:48 [auto1.de] INFO: Found listing with ID: HS83117
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS83117%27 HTTP/1.1" 200 None
2026-03-28 07:37:48 [auto1.de] INFO: Scrape type for HS83117: 0
2026-03-28 07:37:48 [auto1.de] INFO: Found listing with ID: VS10261
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS10261%27 HTTP/1.1" 200 None
2026-03-28 07:37:48 [auto1.de] INFO: Scrape type for VS10261: 0
2026-03-28 07:37:48 [auto1.de] INFO: Found listing with ID: AH42647
2026-03-28 07:37:48 [auto1.de] INFO: Found listing with ID: AL34551
2026-03-28 07:37:48 [auto1.de] INFO: Found listing with ID: WP00727
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP00727%27 HTTP/1.1" 200 None
2026-03-28 07:37:48 [auto1.de] INFO: Scrape type for WP00727: 0
2026-03-28 07:37:48 [auto1.de] INFO: Found listing with ID: NL36228
2026-03-28 07:37:48 [auto1.de] INFO: Found listing with ID: FH96122
2026-03-28 07:37:48 [auto1.de] INFO: Found listing with ID: RC73620
2026-03-28 07:37:48 [auto1.de] INFO: Found listing with ID: KW02770
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW02770%27 HTTP/1.1" 200 None
2026-03-28 07:37:48 [auto1.de] INFO: Scrape type for KW02770: 2
2026-03-28 07:37:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f948479-f368-528b-98fd-6051e59541bc with identifier: KW02770
2026-03-28 07:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f948479-f368-528b-98fd-6051e59541bc with scrape type 2
2026-03-28 07:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f948479-f368-528b-98fd-6051e59541bc with scrape type 2
2026-03-28 07:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f948479-f368-528b-98fd-6051e59541bc, identifier: KW02770
2026-03-28 07:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f948479-f368-528b-98fd-6051e59541bc with identifier: KW02770
2026-03-28 07:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f948479-f368-528b-98fd-6051e59541bc with identifier: KW02770
2026-03-28 07:37:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f948479-f368-528b-98fd-6051e59541bc with identifier: KW02770 to the API
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 68,
'expiration_date': '2026-03-28T16:20:57Z',
'fuel_type': 'petrol',
'id': '7f948479-f368-528b-98fd-6051e59541bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW02770',
'listing': 'auction',
'make': 'Citroen',
'model': 'C1',
'odometer': 112805,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-27',
'seller_name': None,
'title': 'Citroen C1 1.0 Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2010}
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW02770%27 HTTP/1.1" 200 None
2026-03-28 07:37:48 [auto1.de] INFO: Saving data for KW02770: {'auction_closing_time': 1774714857.0, 'created_time': 1774466968.483135, 'last_price_update_time': 1774683468.636147}
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KW02770') HTTP/1.1" 204 0
2026-03-28 07:37:48 [auto1.de] INFO: Found listing with ID: YH14948
2026-03-28 07:37:48 [auto1.de] INFO: Found listing with ID: YY11140
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY11140%27 HTTP/1.1" 200 None
2026-03-28 07:37:48 [auto1.de] INFO: Scrape type for YY11140: 0
2026-03-28 07:37:48 [auto1.de] INFO: Found listing with ID: SY24934
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY24934%27 HTTP/1.1" 200 None
2026-03-28 07:37:48 [auto1.de] INFO: Scrape type for SY24934: 0
2026-03-28 07:37:48 [auto1.de] INFO: Found listing with ID: VW77341
2026-03-28 07:37:48 [auto1.de] INFO: Found listing with ID: PD00491
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD00491%27 HTTP/1.1" 200 None
2026-03-28 07:37:48 [auto1.de] INFO: Scrape type for PD00491: 2
2026-03-28 07:37:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23ae1dcd-54d5-5a87-bc51-3602920ced31 with identifier: PD00491
2026-03-28 07:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23ae1dcd-54d5-5a87-bc51-3602920ced31 with scrape type 2
2026-03-28 07:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23ae1dcd-54d5-5a87-bc51-3602920ced31 with scrape type 2
2026-03-28 07:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23ae1dcd-54d5-5a87-bc51-3602920ced31, identifier: PD00491
2026-03-28 07:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23ae1dcd-54d5-5a87-bc51-3602920ced31 with identifier: PD00491
2026-03-28 07:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23ae1dcd-54d5-5a87-bc51-3602920ced31 with identifier: PD00491
2026-03-28 07:37:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23ae1dcd-54d5-5a87-bc51-3602920ced31 with identifier: PD00491 to the API
2026-03-28 07:37:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:13:10Z',
'fuel_type': 'petrol',
'id': '23ae1dcd-54d5-5a87-bc51-3602920ced31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD00491',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 48291,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-25',
'seller_name': None,
'title': 'Volkswagen Golf VIII 1.0 TSI Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2021}
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD00491%27 HTTP/1.1" 200 None
2026-03-28 07:37:49 [auto1.de] INFO: Saving data for PD00491: {'auction_closing_time': 1774714390.0, 'created_time': 1774464191.23835, 'last_price_update_time': 1774683469.189248}
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD00491') HTTP/1.1" 204 0
2026-03-28 07:37:49 [auto1.de] INFO: Found listing with ID: RE68011
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE68011%27 HTTP/1.1" 200 None
2026-03-28 07:37:49 [auto1.de] INFO: Scrape type for RE68011: 0
2026-03-28 07:37:49 [auto1.de] INFO: Found listing with ID: RY72669
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY72669%27 HTTP/1.1" 200 None
2026-03-28 07:37:49 [auto1.de] INFO: Scrape type for RY72669: 0
2026-03-28 07:37:49 [auto1.de] INFO: Found listing with ID: HS45664
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS45664%27 HTTP/1.1" 200 None
2026-03-28 07:37:49 [auto1.de] INFO: Scrape type for HS45664: 0
2026-03-28 07:37:49 [auto1.de] INFO: Found listing with ID: GA97720
2026-03-28 07:37:49 [auto1.de] INFO: Found listing with ID: LC36947
2026-03-28 07:37:49 [auto1.de] INFO: Found listing with ID: NP46589
2026-03-28 07:37:49 [auto1.de] INFO: Found listing with ID: VT05900
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT05900%27 HTTP/1.1" 200 None
2026-03-28 07:37:49 [auto1.de] INFO: Scrape type for VT05900: 0
2026-03-28 07:37:49 [auto1.de] INFO: Found listing with ID: AK10320
2026-03-28 07:37:49 [auto1.de] INFO: Found listing with ID: PG33349
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG33349%27 HTTP/1.1" 200 None
2026-03-28 07:37:49 [auto1.de] INFO: Scrape type for PG33349: 0
2026-03-28 07:37:49 [auto1.de] INFO: Found listing with ID: AZ88481
2026-03-28 07:37:49 [auto1.de] INFO: Found listing with ID: UJ65232
2026-03-28 07:37:49 [auto1.de] INFO: Found listing with ID: DK90123
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK90123%27 HTTP/1.1" 200 None
2026-03-28 07:37:49 [auto1.de] INFO: Scrape type for DK90123: 2
2026-03-28 07:37:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4a1e322-1271-5b8a-a968-9f840ba9ccff with identifier: DK90123
2026-03-28 07:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4a1e322-1271-5b8a-a968-9f840ba9ccff with scrape type 2
2026-03-28 07:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4a1e322-1271-5b8a-a968-9f840ba9ccff with scrape type 2
2026-03-28 07:37:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4a1e322-1271-5b8a-a968-9f840ba9ccff, identifier: DK90123
2026-03-28 07:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4a1e322-1271-5b8a-a968-9f840ba9ccff with identifier: DK90123
2026-03-28 07:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4a1e322-1271-5b8a-a968-9f840ba9ccff with identifier: DK90123
2026-03-28 07:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4a1e322-1271-5b8a-a968-9f840ba9ccff with identifier: DK90123 to the API
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:53:11Z',
'fuel_type': 'petrol',
'id': 'd4a1e322-1271-5b8a-a968-9f840ba9ccff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK90123',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 54322,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-07-10',
'seller_name': None,
'title': 'Audi A3 Sportback 35 TFSI Mild-Hybrid S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2024}
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK90123%27 HTTP/1.1" 200 None
2026-03-28 07:37:49 [auto1.de] INFO: Saving data for DK90123: {'auction_closing_time': 1774716791.0, 'created_time': 1774466978.295494, 'last_price_update_time': 1774683469.742701}
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK90123') HTTP/1.1" 204 0
2026-03-28 07:37:49 [auto1.de] INFO: Found listing with ID: DV48088
2026-03-28 07:37:49 [auto1.de] INFO: Found listing with ID: AZ12624
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ12624%27 HTTP/1.1" 200 None
2026-03-28 07:37:49 [auto1.de] INFO: Scrape type for AZ12624: 0
2026-03-28 07:37:49 [auto1.de] INFO: Found listing with ID: MT86254
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT86254%27 HTTP/1.1" 200 None
2026-03-28 07:37:49 [auto1.de] INFO: Scrape type for MT86254: 0
2026-03-28 07:37:49 [auto1.de] INFO: Found listing with ID: GR34047
2026-03-28 07:37:49 [auto1.de] INFO: Found listing with ID: SR63884
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR63884%27 HTTP/1.1" 200 None
2026-03-28 07:37:49 [auto1.de] INFO: Scrape type for SR63884: 0
2026-03-28 07:37:49 [auto1.de] INFO: Found listing with ID: NW61921
2026-03-28 07:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:37:50 [auto1.de] INFO: Channel: 24h | Page: 92 | totalHits: 9257 | hits on page: 40
2026-03-28 07:37:50 [auto1.de] INFO: Found listing with ID: YP60462
2026-03-28 07:37:50 [auto1.de] INFO: Found listing with ID: XW72193
2026-03-28 07:37:50 [auto1.de] INFO: Found listing with ID: HC77687
2026-03-28 07:37:50 [auto1.de] INFO: Found listing with ID: JR17394
2026-03-28 07:37:50 [auto1.de] INFO: Found listing with ID: FP18966
2026-03-28 07:37:50 [auto1.de] INFO: Found listing with ID: CS08298
2026-03-28 07:37:50 [auto1.de] INFO: Found listing with ID: MD58686
2026-03-28 07:37:50 [auto1.de] INFO: Found listing with ID: RT60437
2026-03-28 07:37:50 [auto1.de] INFO: Found listing with ID: SS72230
2026-03-28 07:37:50 [auto1.de] INFO: Found listing with ID: AW71127
2026-03-28 07:37:50 [auto1.de] INFO: Found listing with ID: BN04520
2026-03-28 07:37:50 [auto1.de] INFO: Found listing with ID: SR89713
2026-03-28 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR89713%27 HTTP/1.1" 200 None
2026-03-28 07:37:50 [auto1.de] INFO: Scrape type for SR89713: 2
2026-03-28 07:37:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58fe3926-6c4d-5974-8efc-a11e2df3b155 with identifier: SR89713
2026-03-28 07:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58fe3926-6c4d-5974-8efc-a11e2df3b155 with scrape type 2
2026-03-28 07:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58fe3926-6c4d-5974-8efc-a11e2df3b155 with scrape type 2
2026-03-28 07:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58fe3926-6c4d-5974-8efc-a11e2df3b155, identifier: SR89713
2026-03-28 07:37:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58fe3926-6c4d-5974-8efc-a11e2df3b155 with identifier: SR89713
2026-03-28 07:37:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58fe3926-6c4d-5974-8efc-a11e2df3b155 with identifier: SR89713
2026-03-28 07:37:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58fe3926-6c4d-5974-8efc-a11e2df3b155 with identifier: SR89713 to the API
2026-03-28 07:37:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:02:01Z',
'fuel_type': 'petrol',
'id': '58fe3926-6c4d-5974-8efc-a11e2df3b155',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR89713',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 28520,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-30',
'seller_name': None,
'title': 'Dacia Duster 1.3 TCe Journey+',
'transmission': 'manual',
'trim': 'Journey+',
'year': 2023}
2026-03-28 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR89713%27 HTTP/1.1" 200 None
2026-03-28 07:37:51 [auto1.de] INFO: Saving data for SR89713: {'auction_closing_time': 1774713721.0, 'created_time': 1774466504.282013, 'last_price_update_time': 1774683471.26946}
2026-03-28 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR89713') HTTP/1.1" 204 0
2026-03-28 07:37:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:37:51 [auto1.de] INFO: Found listing with ID: FZ71323
2026-03-28 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ71323%27 HTTP/1.1" 200 None
2026-03-28 07:37:51 [auto1.de] INFO: Scrape type for FZ71323: 0
2026-03-28 07:37:51 [auto1.de] INFO: Found listing with ID: KH76596
2026-03-28 07:37:51 [auto1.de] INFO: Found listing with ID: MT34659
2026-03-28 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT34659%27 HTTP/1.1" 200 None
2026-03-28 07:37:51 [auto1.de] INFO: Scrape type for MT34659: 2
2026-03-28 07:37:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6586f20b-f13f-53db-843f-d2e51fa436b3 with identifier: MT34659
2026-03-28 07:37:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6586f20b-f13f-53db-843f-d2e51fa436b3 with scrape type 2
2026-03-28 07:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6586f20b-f13f-53db-843f-d2e51fa436b3 with scrape type 2
2026-03-28 07:37:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6586f20b-f13f-53db-843f-d2e51fa436b3, identifier: MT34659
2026-03-28 07:37:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6586f20b-f13f-53db-843f-d2e51fa436b3 with identifier: MT34659
2026-03-28 07:37:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6586f20b-f13f-53db-843f-d2e51fa436b3 with identifier: MT34659
2026-03-28 07:37:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6586f20b-f13f-53db-843f-d2e51fa436b3 with identifier: MT34659 to the API
2026-03-28 07:37:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:45:19Z',
'fuel_type': 'petrol',
'id': '6586f20b-f13f-53db-843f-d2e51fa436b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT34659',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 64283,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-26',
'seller_name': None,
'title': 'Hyundai i20 1.2 Go',
'transmission': 'manual',
'trim': 'Go',
'year': 2017}
2026-03-28 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT34659%27 HTTP/1.1" 200 None
2026-03-28 07:37:51 [auto1.de] INFO: Saving data for MT34659: {'auction_closing_time': 1774716319.0, 'created_time': 1774467807.603826, 'last_price_update_time': 1774683471.851973}
2026-03-28 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT34659') HTTP/1.1" 204 0
2026-03-28 07:37:51 [auto1.de] INFO: Found listing with ID: GV12841
2026-03-28 07:37:51 [auto1.de] INFO: Found listing with ID: KW21361
2026-03-28 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW21361%27 HTTP/1.1" 200 None
2026-03-28 07:37:51 [auto1.de] INFO: Scrape type for KW21361: 2
2026-03-28 07:37:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 627984be-e0c6-5389-a9a1-a8417671536c with identifier: KW21361
2026-03-28 07:37:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 627984be-e0c6-5389-a9a1-a8417671536c with scrape type 2
2026-03-28 07:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 627984be-e0c6-5389-a9a1-a8417671536c with scrape type 2
2026-03-28 07:37:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 627984be-e0c6-5389-a9a1-a8417671536c, identifier: KW21361
2026-03-28 07:37:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 627984be-e0c6-5389-a9a1-a8417671536c with identifier: KW21361
2026-03-28 07:37:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 627984be-e0c6-5389-a9a1-a8417671536c with identifier: KW21361
2026-03-28 07:37:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 627984be-e0c6-5389-a9a1-a8417671536c with identifier: KW21361 to the API
2026-03-28 07:37:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 160,
'expiration_date': '2026-03-28T16:35:38Z',
'fuel_type': 'petrol',
'id': '627984be-e0c6-5389-a9a1-a8417671536c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW21361',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 91489,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-17',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-28 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW21361%27 HTTP/1.1" 200 None
2026-03-28 07:37:52 [auto1.de] INFO: Saving data for KW21361: {'auction_closing_time': 1774715738.0, 'created_time': 1774466000.472903, 'last_price_update_time': 1774683472.719648}
2026-03-28 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KW21361') HTTP/1.1" 204 0
2026-03-28 07:37:52 [auto1.de] INFO: Found listing with ID: CP67844
2026-03-28 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP67844%27 HTTP/1.1" 200 None
2026-03-28 07:37:52 [auto1.de] INFO: Scrape type for CP67844: 0
2026-03-28 07:37:52 [auto1.de] INFO: Found listing with ID: TS77277
2026-03-28 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS77277%27 HTTP/1.1" 200 None
2026-03-28 07:37:52 [auto1.de] INFO: Scrape type for TS77277: 2
2026-03-28 07:37:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 773718f6-bdb8-519a-9e29-07a8c43898ce with identifier: TS77277
2026-03-28 07:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 773718f6-bdb8-519a-9e29-07a8c43898ce with scrape type 2
2026-03-28 07:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 773718f6-bdb8-519a-9e29-07a8c43898ce with scrape type 2
2026-03-28 07:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 773718f6-bdb8-519a-9e29-07a8c43898ce, identifier: TS77277
2026-03-28 07:37:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 773718f6-bdb8-519a-9e29-07a8c43898ce with identifier: TS77277
2026-03-28 07:37:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 773718f6-bdb8-519a-9e29-07a8c43898ce with identifier: TS77277
2026-03-28 07:37:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 773718f6-bdb8-519a-9e29-07a8c43898ce with identifier: TS77277 to the API
2026-03-28 07:37:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:05:05Z',
'fuel_type': 'diesel',
'id': '773718f6-bdb8-519a-9e29-07a8c43898ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS77277',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T4 Caravelle',
'odometer': 348005,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1997-02-28',
'seller_name': None,
'title': 'Volkswagen T4 Caravelle 2.5 TDI GL',
'transmission': 'manual',
'trim': 'GL',
'year': 1997}
2026-03-28 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS77277%27 HTTP/1.1" 200 None
2026-03-28 07:37:53 [auto1.de] INFO: Saving data for TS77277: {'auction_closing_time': 1774713905.0, 'created_time': 1774466962.401334, 'last_price_update_time': 1774683473.181677}
2026-03-28 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS77277') HTTP/1.1" 204 0
2026-03-28 07:37:53 [auto1.de] INFO: Found listing with ID: JS09258
2026-03-28 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS09258%27 HTTP/1.1" 200 None
2026-03-28 07:37:53 [auto1.de] INFO: Scrape type for JS09258: 0
2026-03-28 07:37:53 [auto1.de] INFO: Found listing with ID: EE13934
2026-03-28 07:37:53 [auto1.de] INFO: Found listing with ID: UR30493
2026-03-28 07:37:53 [auto1.de] INFO: Found listing with ID: AR62221
2026-03-28 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR62221%27 HTTP/1.1" 200 None
2026-03-28 07:37:53 [auto1.de] INFO: Scrape type for AR62221: 0
2026-03-28 07:37:53 [auto1.de] INFO: Found listing with ID: KU99299
2026-03-28 07:37:53 [auto1.de] INFO: Found listing with ID: TE34583
2026-03-28 07:37:53 [auto1.de] INFO: Found listing with ID: KA96977
2026-03-28 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA96977%27 HTTP/1.1" 200 None
2026-03-28 07:37:53 [auto1.de] INFO: Scrape type for KA96977: 2
2026-03-28 07:37:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51be17f3-609a-59b2-8605-310464f438d9 with identifier: KA96977
2026-03-28 07:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51be17f3-609a-59b2-8605-310464f438d9 with scrape type 2
2026-03-28 07:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51be17f3-609a-59b2-8605-310464f438d9 with scrape type 2
2026-03-28 07:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 51be17f3-609a-59b2-8605-310464f438d9, identifier: KA96977
2026-03-28 07:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 51be17f3-609a-59b2-8605-310464f438d9 with identifier: KA96977
2026-03-28 07:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 51be17f3-609a-59b2-8605-310464f438d9 with identifier: KA96977
2026-03-28 07:37:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 51be17f3-609a-59b2-8605-310464f438d9 with identifier: KA96977 to the API
2026-03-28 07:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 381,
'expiration_date': '2026-03-28T16:46:16Z',
'fuel_type': 'hybrid',
'id': '51be17f3-609a-59b2-8605-310464f438d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA96977',
'listing': 'auction',
'make': 'Audi',
'model': 'Q8',
'odometer': 150796,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-14',
'seller_name': None,
'title': 'Audi Q8 55 TFSIe quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2020}
2026-03-28 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA96977%27 HTTP/1.1" 200 None
2026-03-28 07:37:54 [auto1.de] INFO: Saving data for KA96977: {'auction_closing_time': 1774716376.0, 'created_time': 1774468034.703257, 'last_price_update_time': 1774683474.221004}
2026-03-28 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA96977') HTTP/1.1" 204 0
2026-03-28 07:37:54 [auto1.de] INFO: Found listing with ID: LW41921
2026-03-28 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW41921%27 HTTP/1.1" 200 None
2026-03-28 07:37:54 [auto1.de] INFO: Scrape type for LW41921: 0
2026-03-28 07:37:54 [auto1.de] INFO: Found listing with ID: RZ48384
2026-03-28 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ48384%27 HTTP/1.1" 200 None
2026-03-28 07:37:54 [auto1.de] INFO: Scrape type for RZ48384: 0
2026-03-28 07:37:54 [auto1.de] INFO: Found listing with ID: PV97314
2026-03-28 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV97314%27 HTTP/1.1" 200 None
2026-03-28 07:37:54 [auto1.de] INFO: Scrape type for PV97314: 0
2026-03-28 07:37:54 [auto1.de] INFO: Found listing with ID: KC01296
2026-03-28 07:37:54 [auto1.de] INFO: Found listing with ID: TW01944
2026-03-28 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW01944%27 HTTP/1.1" 200 None
2026-03-28 07:37:54 [auto1.de] INFO: Scrape type for TW01944: 0
2026-03-28 07:37:54 [auto1.de] INFO: Found listing with ID: ZW06761
2026-03-28 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW06761%27 HTTP/1.1" 200 None
2026-03-28 07:37:54 [auto1.de] INFO: Scrape type for ZW06761: 0
2026-03-28 07:37:54 [auto1.de] INFO: Found listing with ID: FN32159
2026-03-28 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN32159%27 HTTP/1.1" 200 None
2026-03-28 07:37:54 [auto1.de] INFO: Scrape type for FN32159: 0
2026-03-28 07:37:54 [auto1.de] INFO: Found listing with ID: MK32752
2026-03-28 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK32752%27 HTTP/1.1" 200 None
2026-03-28 07:37:54 [auto1.de] INFO: Scrape type for MK32752: 0
2026-03-28 07:37:54 [auto1.de] INFO: Found listing with ID: AU19422
2026-03-28 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU19422%27 HTTP/1.1" 200 None
2026-03-28 07:37:54 [auto1.de] INFO: Scrape type for AU19422: 2
2026-03-28 07:37:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d74cccd-ea65-5674-86d0-53694e5f4a3f with identifier: AU19422
2026-03-28 07:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d74cccd-ea65-5674-86d0-53694e5f4a3f with scrape type 2
2026-03-28 07:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d74cccd-ea65-5674-86d0-53694e5f4a3f with scrape type 2
2026-03-28 07:37:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d74cccd-ea65-5674-86d0-53694e5f4a3f, identifier: AU19422
2026-03-28 07:37:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d74cccd-ea65-5674-86d0-53694e5f4a3f with identifier: AU19422
2026-03-28 07:37:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d74cccd-ea65-5674-86d0-53694e5f4a3f with identifier: AU19422
2026-03-28 07:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d74cccd-ea65-5674-86d0-53694e5f4a3f with identifier: AU19422 to the API
2026-03-28 07:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-28T16:07:58Z',
'fuel_type': 'petrol',
'id': '3d74cccd-ea65-5674-86d0-53694e5f4a3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU19422',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 352846,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-26',
'seller_name': None,
'title': 'Audi A4 1.8 TFSI quattro S line Sportpaket plus',
'transmission': 'manual',
'trim': 'quattro S line Sportpaket plus',
'year': 2010}
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU19422%27 HTTP/1.1" 200 None
2026-03-28 07:37:55 [auto1.de] INFO: Saving data for AU19422: {'auction_closing_time': 1774714078.0, 'created_time': 1774467023.363316, 'last_price_update_time': 1774683475.666399}
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU19422') HTTP/1.1" 204 0
2026-03-28 07:37:55 [auto1.de] INFO: Found listing with ID: JF43262
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF43262%27 HTTP/1.1" 200 None
2026-03-28 07:37:55 [auto1.de] INFO: Scrape type for JF43262: 0
2026-03-28 07:37:55 [auto1.de] INFO: Found listing with ID: YC48203
2026-03-28 07:37:55 [auto1.de] INFO: Found listing with ID: XH77572
2026-03-28 07:37:55 [auto1.de] INFO: Found listing with ID: FT62764
2026-03-28 07:37:55 [auto1.de] INFO: Found listing with ID: ZJ19355
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ19355%27 HTTP/1.1" 200 None
2026-03-28 07:37:55 [auto1.de] INFO: Scrape type for ZJ19355: 0
2026-03-28 07:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:37:55 [auto1.de] INFO: Channel: 24h | Page: 93 | totalHits: 9257 | hits on page: 40
2026-03-28 07:37:55 [auto1.de] INFO: Found listing with ID: YL64188
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL64188%27 HTTP/1.1" 200 None
2026-03-28 07:37:55 [auto1.de] INFO: Scrape type for YL64188: 0
2026-03-28 07:37:55 [auto1.de] INFO: Found listing with ID: MM26865
2026-03-28 07:37:55 [auto1.de] INFO: Found listing with ID: MY02609
2026-03-28 07:37:55 [auto1.de] INFO: Found listing with ID: VN84329
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN84329%27 HTTP/1.1" 200 None
2026-03-28 07:37:55 [auto1.de] INFO: Scrape type for VN84329: 0
2026-03-28 07:37:55 [auto1.de] INFO: Found listing with ID: SK50734
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK50734%27 HTTP/1.1" 200 None
2026-03-28 07:37:55 [auto1.de] INFO: Scrape type for SK50734: 0
2026-03-28 07:37:55 [auto1.de] INFO: Found listing with ID: JN34969
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN34969%27 HTTP/1.1" 200 None
2026-03-28 07:37:55 [auto1.de] INFO: Scrape type for JN34969: 0
2026-03-28 07:37:55 [auto1.de] INFO: Found listing with ID: CY63402
2026-03-28 07:37:55 [auto1.de] INFO: Found listing with ID: LV93529
2026-03-28 07:37:55 [auto1.de] INFO: Found listing with ID: FG94597
2026-03-28 07:37:55 [auto1.de] INFO: Found listing with ID: ZP94489
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP94489%27 HTTP/1.1" 200 None
2026-03-28 07:37:55 [auto1.de] INFO: Scrape type for ZP94489: 0
2026-03-28 07:37:55 [auto1.de] INFO: Found listing with ID: ZA82143
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA82143%27 HTTP/1.1" 200 None
2026-03-28 07:37:55 [auto1.de] INFO: Scrape type for ZA82143: 0
2026-03-28 07:37:55 [auto1.de] INFO: Found listing with ID: LG94407
2026-03-28 07:37:55 [auto1.de] INFO: Found listing with ID: CY68154
2026-03-28 07:37:55 [auto1.de] INFO: Found listing with ID: TE07006
2026-03-28 07:37:55 [auto1.de] INFO: Found listing with ID: FL38962
2026-03-28 07:37:55 [auto1.de] INFO: Found listing with ID: EK46666
2026-03-28 07:37:55 [auto1.de] INFO: Found listing with ID: DZ51927
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ51927%27 HTTP/1.1" 200 None
2026-03-28 07:37:55 [auto1.de] INFO: Scrape type for DZ51927: 0
2026-03-28 07:37:55 [auto1.de] INFO: Found listing with ID: HW81308
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW81308%27 HTTP/1.1" 200 None
2026-03-28 07:37:55 [auto1.de] INFO: Scrape type for HW81308: 0
2026-03-28 07:37:55 [auto1.de] INFO: Found listing with ID: RA23936
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA23936%27 HTTP/1.1" 200 None
2026-03-28 07:37:55 [auto1.de] INFO: Scrape type for RA23936: 2
2026-03-28 07:37:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0ff1320-d518-51bd-8ee1-d84d10f21db9 with identifier: RA23936
2026-03-28 07:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0ff1320-d518-51bd-8ee1-d84d10f21db9 with scrape type 2
2026-03-28 07:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0ff1320-d518-51bd-8ee1-d84d10f21db9 with scrape type 2
2026-03-28 07:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b0ff1320-d518-51bd-8ee1-d84d10f21db9, identifier: RA23936
2026-03-28 07:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b0ff1320-d518-51bd-8ee1-d84d10f21db9 with identifier: RA23936
2026-03-28 07:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b0ff1320-d518-51bd-8ee1-d84d10f21db9 with identifier: RA23936
2026-03-28 07:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b0ff1320-d518-51bd-8ee1-d84d10f21db9 with identifier: RA23936 to the API
2026-03-28 07:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 400,
'expiration_date': '2026-03-28T16:05:54Z',
'fuel_type': 'petrol',
'id': 'b0ff1320-d518-51bd-8ee1-d84d10f21db9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA23936',
'listing': 'auction',
'make': 'Audi',
'model': 'RS 3 Sportback',
'odometer': 122916,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-05',
'seller_name': None,
'title': 'Audi RS 3 Sportback 2.5 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2019}
2026-03-28 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA23936%27 HTTP/1.1" 200 None
2026-03-28 07:37:56 [auto1.de] INFO: Saving data for RA23936: {'auction_closing_time': 1774713954.0, 'created_time': 1774465757.170554, 'last_price_update_time': 1774683476.48974}
2026-03-28 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA23936') HTTP/1.1" 204 0
2026-03-28 07:37:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:37:56 [auto1.de] INFO: Found listing with ID: RU45291
2026-03-28 07:37:56 [auto1.de] INFO: Found listing with ID: SG68469
2026-03-28 07:37:56 [auto1.de] INFO: Found listing with ID: ZT67074
2026-03-28 07:37:56 [auto1.de] INFO: Found listing with ID: CA27289
2026-03-28 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA27289%27 HTTP/1.1" 200 None
2026-03-28 07:37:56 [auto1.de] INFO: Scrape type for CA27289: 0
2026-03-28 07:37:56 [auto1.de] INFO: Found listing with ID: PU90892
2026-03-28 07:37:56 [auto1.de] INFO: Found listing with ID: XA59462
2026-03-28 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA59462%27 HTTP/1.1" 200 None
2026-03-28 07:37:56 [auto1.de] INFO: Scrape type for XA59462: 0
2026-03-28 07:37:56 [auto1.de] INFO: Found listing with ID: UM65045
2026-03-28 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM65045%27 HTTP/1.1" 200 None
2026-03-28 07:37:56 [auto1.de] INFO: Scrape type for UM65045: 0
2026-03-28 07:37:56 [auto1.de] INFO: Found listing with ID: GJ75374
2026-03-28 07:37:56 [auto1.de] INFO: Found listing with ID: HE80125
2026-03-28 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE80125%27 HTTP/1.1" 200 None
2026-03-28 07:37:56 [auto1.de] INFO: Scrape type for HE80125: 0
2026-03-28 07:37:56 [auto1.de] INFO: Found listing with ID: YY27100
2026-03-28 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY27100%27 HTTP/1.1" 200 None
2026-03-28 07:37:56 [auto1.de] INFO: Scrape type for YY27100: 0
2026-03-28 07:37:56 [auto1.de] INFO: Found listing with ID: XP12912
2026-03-28 07:37:56 [auto1.de] INFO: Found listing with ID: KZ11902
2026-03-28 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ11902%27 HTTP/1.1" 200 None
2026-03-28 07:37:56 [auto1.de] INFO: Scrape type for KZ11902: 0
2026-03-28 07:37:56 [auto1.de] INFO: Found listing with ID: CK59033
2026-03-28 07:37:56 [auto1.de] INFO: Found listing with ID: BP69075
2026-03-28 07:37:56 [auto1.de] INFO: Found listing with ID: KK88346
2026-03-28 07:37:56 [auto1.de] INFO: Found listing with ID: XG53445
2026-03-28 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG53445%27 HTTP/1.1" 200 None
2026-03-28 07:37:56 [auto1.de] INFO: Scrape type for XG53445: 0
2026-03-28 07:37:56 [auto1.de] INFO: Found listing with ID: XP11073
2026-03-28 07:37:56 [auto1.de] INFO: Found listing with ID: ZN09383
2026-03-28 07:37:56 [auto1.de] INFO: Found listing with ID: VX77411
2026-03-28 07:37:56 [auto1.de] INFO: Found listing with ID: FG17963
2026-03-28 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG17963%27 HTTP/1.1" 200 None
2026-03-28 07:37:56 [auto1.de] INFO: Scrape type for FG17963: 2
2026-03-28 07:37:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 514c9733-363a-59e4-a349-5111937e622d with identifier: FG17963
2026-03-28 07:37:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 514c9733-363a-59e4-a349-5111937e622d with scrape type 2
2026-03-28 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 514c9733-363a-59e4-a349-5111937e622d with scrape type 2
2026-03-28 07:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 514c9733-363a-59e4-a349-5111937e622d, identifier: FG17963
2026-03-28 07:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 514c9733-363a-59e4-a349-5111937e622d with identifier: FG17963
2026-03-28 07:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 514c9733-363a-59e4-a349-5111937e622d with identifier: FG17963
2026-03-28 07:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 514c9733-363a-59e4-a349-5111937e622d with identifier: FG17963 to the API
2026-03-28 07:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:20:59Z',
'fuel_type': 'petrol',
'id': '514c9733-363a-59e4-a349-5111937e622d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG17963',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 156236,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-25',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.2 TSI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2012}
2026-03-28 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG17963%27 HTTP/1.1" 200 None
2026-03-28 07:37:57 [auto1.de] INFO: Saving data for FG17963: {'auction_closing_time': 1774714859.0, 'created_time': 1774503047.693972, 'last_price_update_time': 1774683477.279955}
2026-03-28 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG17963') HTTP/1.1" 204 0
2026-03-28 07:37:57 [auto1.de] INFO: Found listing with ID: CD05825
2026-03-28 07:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:37:58 [auto1.de] INFO: Channel: 24h | Page: 94 | totalHits: 9257 | hits on page: 40
2026-03-28 07:37:58 [auto1.de] INFO: Found listing with ID: CZ50772
2026-03-28 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ50772%27 HTTP/1.1" 200 None
2026-03-28 07:37:58 [auto1.de] INFO: Scrape type for CZ50772: 0
2026-03-28 07:37:58 [auto1.de] INFO: Found listing with ID: MA82024
2026-03-28 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA82024%27 HTTP/1.1" 200 None
2026-03-28 07:37:58 [auto1.de] INFO: Scrape type for MA82024: 0
2026-03-28 07:37:58 [auto1.de] INFO: Found listing with ID: VY22593
2026-03-28 07:37:58 [auto1.de] INFO: Found listing with ID: UX47002
2026-03-28 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX47002%27 HTTP/1.1" 200 None
2026-03-28 07:37:58 [auto1.de] INFO: Scrape type for UX47002: 0
2026-03-28 07:37:58 [auto1.de] INFO: Found listing with ID: RN81514
2026-03-28 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN81514%27 HTTP/1.1" 200 None
2026-03-28 07:37:58 [auto1.de] INFO: Scrape type for RN81514: 0
2026-03-28 07:37:58 [auto1.de] INFO: Found listing with ID: ZS98527
2026-03-28 07:37:58 [auto1.de] INFO: Found listing with ID: LX19863
2026-03-28 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX19863%27 HTTP/1.1" 200 None
2026-03-28 07:37:58 [auto1.de] INFO: Scrape type for LX19863: 2
2026-03-28 07:37:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1a7085f-7891-5b10-ac8f-184bde4789fd with identifier: LX19863
2026-03-28 07:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1a7085f-7891-5b10-ac8f-184bde4789fd with scrape type 2
2026-03-28 07:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1a7085f-7891-5b10-ac8f-184bde4789fd with scrape type 2
2026-03-28 07:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e1a7085f-7891-5b10-ac8f-184bde4789fd, identifier: LX19863
2026-03-28 07:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e1a7085f-7891-5b10-ac8f-184bde4789fd with identifier: LX19863
2026-03-28 07:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e1a7085f-7891-5b10-ac8f-184bde4789fd with identifier: LX19863
2026-03-28 07:37:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e1a7085f-7891-5b10-ac8f-184bde4789fd with identifier: LX19863 to the API
2026-03-28 07:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:37:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:10:24Z',
'fuel_type': 'diesel',
'id': 'e1a7085f-7891-5b10-ac8f-184bde4789fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX19863',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 172572,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-27',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion',
'transmission': 'automatic',
'trim': 'GTD BlueMotion',
'year': 2017}
2026-03-28 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX19863%27 HTTP/1.1" 200 None
2026-03-28 07:37:59 [auto1.de] INFO: Saving data for LX19863: {'auction_closing_time': 1774714224.0, 'created_time': 1774465836.855441, 'last_price_update_time': 1774683479.889953}
2026-03-28 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX19863') HTTP/1.1" 204 0
2026-03-28 07:37:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:37:59 [auto1.de] INFO: Found listing with ID: FU95957
2026-03-28 07:37:59 [auto1.de] INFO: Found listing with ID: TX92372
2026-03-28 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92372%27 HTTP/1.1" 200 None
2026-03-28 07:37:59 [auto1.de] INFO: Scrape type for TX92372: 0
2026-03-28 07:37:59 [auto1.de] INFO: Found listing with ID: SH68668
2026-03-28 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH68668%27 HTTP/1.1" 200 None
2026-03-28 07:37:59 [auto1.de] INFO: Scrape type for SH68668: 2
2026-03-28 07:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74d745c6-b333-5000-9e49-eafecb022666 with identifier: SH68668
2026-03-28 07:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74d745c6-b333-5000-9e49-eafecb022666 with scrape type 2
2026-03-28 07:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74d745c6-b333-5000-9e49-eafecb022666 with scrape type 2
2026-03-28 07:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74d745c6-b333-5000-9e49-eafecb022666, identifier: SH68668
2026-03-28 07:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74d745c6-b333-5000-9e49-eafecb022666 with identifier: SH68668
2026-03-28 07:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74d745c6-b333-5000-9e49-eafecb022666 with identifier: SH68668
2026-03-28 07:38:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74d745c6-b333-5000-9e49-eafecb022666 with identifier: SH68668 to the API
2026-03-28 07:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 65,
'expiration_date': '2026-03-28T16:51:38Z',
'fuel_type': 'petrol',
'id': '74d745c6-b333-5000-9e49-eafecb022666',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH68668',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'up!',
'odometer': 62776,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-08',
'seller_name': None,
'title': 'Volkswagen up! 1.0',
'transmission': 'manual',
'trim': '',
'year': 2021}
2026-03-28 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH68668%27 HTTP/1.1" 200 None
2026-03-28 07:38:00 [auto1.de] INFO: Saving data for SH68668: {'auction_closing_time': 1774716698.0, 'created_time': 1774466857.429545, 'last_price_update_time': 1774683480.39181}
2026-03-28 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SH68668') HTTP/1.1" 204 0
2026-03-28 07:38:00 [auto1.de] INFO: Found listing with ID: EN47002
2026-03-28 07:38:00 [auto1.de] INFO: Found listing with ID: LV09393
2026-03-28 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV09393%27 HTTP/1.1" 200 None
2026-03-28 07:38:00 [auto1.de] INFO: Scrape type for LV09393: 0
2026-03-28 07:38:00 [auto1.de] INFO: Found listing with ID: RE90038
2026-03-28 07:38:00 [auto1.de] INFO: Found listing with ID: JR29139
2026-03-28 07:38:00 [auto1.de] INFO: Found listing with ID: DB61618
2026-03-28 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB61618%27 HTTP/1.1" 200 None
2026-03-28 07:38:00 [auto1.de] INFO: Scrape type for DB61618: 0
2026-03-28 07:38:00 [auto1.de] INFO: Found listing with ID: FD50641
2026-03-28 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD50641%27 HTTP/1.1" 200 None
2026-03-28 07:38:00 [auto1.de] INFO: Scrape type for FD50641: 2
2026-03-28 07:38:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fd8439b-b070-5a48-8187-90f2023000c6 with identifier: FD50641
2026-03-28 07:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fd8439b-b070-5a48-8187-90f2023000c6 with scrape type 2
2026-03-28 07:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fd8439b-b070-5a48-8187-90f2023000c6 with scrape type 2
2026-03-28 07:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9fd8439b-b070-5a48-8187-90f2023000c6, identifier: FD50641
2026-03-28 07:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9fd8439b-b070-5a48-8187-90f2023000c6 with identifier: FD50641
2026-03-28 07:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9fd8439b-b070-5a48-8187-90f2023000c6 with identifier: FD50641
2026-03-28 07:38:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9fd8439b-b070-5a48-8187-90f2023000c6 with identifier: FD50641 to the API
2026-03-28 07:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:39:19Z',
'fuel_type': 'diesel',
'id': '9fd8439b-b070-5a48-8187-90f2023000c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD50641',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Multivan',
'odometer': 121617,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-24',
'seller_name': None,
'title': 'Volkswagen T5 Multivan 2.0 TDI Special',
'transmission': 'manual',
'trim': 'Special',
'year': 2013}
2026-03-28 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD50641%27 HTTP/1.1" 200 None
2026-03-28 07:38:01 [auto1.de] INFO: Saving data for FD50641: {'auction_closing_time': 1774715959.0, 'created_time': 1774466100.407619, 'last_price_update_time': 1774683481.368947}
2026-03-28 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD50641') HTTP/1.1" 204 0
2026-03-28 07:38:01 [auto1.de] INFO: Found listing with ID: FJ00184
2026-03-28 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ00184%27 HTTP/1.1" 200 None
2026-03-28 07:38:01 [auto1.de] INFO: Scrape type for FJ00184: 0
2026-03-28 07:38:01 [auto1.de] INFO: Found listing with ID: PC66618
2026-03-28 07:38:01 [auto1.de] INFO: Found listing with ID: VP49829
2026-03-28 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP49829%27 HTTP/1.1" 200 None
2026-03-28 07:38:01 [auto1.de] INFO: Scrape type for VP49829: 2
2026-03-28 07:38:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43a2abb1-2763-51e5-950e-f8abb90a9635 with identifier: VP49829
2026-03-28 07:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43a2abb1-2763-51e5-950e-f8abb90a9635 with scrape type 2
2026-03-28 07:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43a2abb1-2763-51e5-950e-f8abb90a9635 with scrape type 2
2026-03-28 07:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43a2abb1-2763-51e5-950e-f8abb90a9635, identifier: VP49829
2026-03-28 07:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43a2abb1-2763-51e5-950e-f8abb90a9635 with identifier: VP49829
2026-03-28 07:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43a2abb1-2763-51e5-950e-f8abb90a9635 with identifier: VP49829
2026-03-28 07:38:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43a2abb1-2763-51e5-950e-f8abb90a9635 with identifier: VP49829 to the API
2026-03-28 07:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:07:13Z',
'fuel_type': 'petrol',
'id': '43a2abb1-2763-51e5-950e-f8abb90a9635',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP49829',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 124716,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-10',
'seller_name': None,
'title': 'Skoda Octavia 1.2 TSI Family',
'transmission': 'manual',
'trim': 'Family',
'year': 2012}
2026-03-28 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP49829%27 HTTP/1.1" 200 None
2026-03-28 07:38:01 [auto1.de] INFO: Saving data for VP49829: {'auction_closing_time': 1774714033.0, 'created_time': 1773830556.031038, 'last_price_update_time': 1774683481.874499}
2026-03-28 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VP49829') HTTP/1.1" 204 0
2026-03-28 07:38:01 [auto1.de] INFO: Found listing with ID: PK44731
2026-03-28 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK44731%27 HTTP/1.1" 200 None
2026-03-28 07:38:01 [auto1.de] INFO: Scrape type for PK44731: 2
2026-03-28 07:38:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ea4f200-b5e0-5802-be1e-e908c36df6ac with identifier: PK44731
2026-03-28 07:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ea4f200-b5e0-5802-be1e-e908c36df6ac with scrape type 2
2026-03-28 07:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ea4f200-b5e0-5802-be1e-e908c36df6ac with scrape type 2
2026-03-28 07:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ea4f200-b5e0-5802-be1e-e908c36df6ac, identifier: PK44731
2026-03-28 07:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ea4f200-b5e0-5802-be1e-e908c36df6ac with identifier: PK44731
2026-03-28 07:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ea4f200-b5e0-5802-be1e-e908c36df6ac with identifier: PK44731
2026-03-28 07:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ea4f200-b5e0-5802-be1e-e908c36df6ac with identifier: PK44731 to the API
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 320,
'expiration_date': '2026-03-28T16:41:42Z',
'fuel_type': 'petrol',
'id': '7ea4f200-b5e0-5802-be1e-e908c36df6ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK44731',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Arteon Shooting Brake',
'odometer': 39926,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-06',
'seller_name': None,
'title': 'Volkswagen Arteon Shooting Brake 2.0 TSI R 4Motion',
'transmission': 'automatic',
'trim': 'R 4Motion',
'year': 2022}
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK44731%27 HTTP/1.1" 200 None
2026-03-28 07:38:02 [auto1.de] INFO: Saving data for PK44731: {'auction_closing_time': 1774716102.0, 'created_time': 1774466021.366471, 'last_price_update_time': 1774683482.304631}
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK44731') HTTP/1.1" 204 0
2026-03-28 07:38:02 [auto1.de] INFO: Found listing with ID: VP79611
2026-03-28 07:38:02 [auto1.de] INFO: Found listing with ID: LR43035
2026-03-28 07:38:02 [auto1.de] INFO: Found listing with ID: JZ88133
2026-03-28 07:38:02 [auto1.de] INFO: Found listing with ID: MH82983
2026-03-28 07:38:02 [auto1.de] INFO: Found listing with ID: ZB28652
2026-03-28 07:38:02 [auto1.de] INFO: Found listing with ID: JS73501
2026-03-28 07:38:02 [auto1.de] INFO: Found listing with ID: FK93420
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93420%27 HTTP/1.1" 200 None
2026-03-28 07:38:02 [auto1.de] INFO: Scrape type for FK93420: 0
2026-03-28 07:38:02 [auto1.de] INFO: Found listing with ID: HL11639
2026-03-28 07:38:02 [auto1.de] INFO: Found listing with ID: GZ60410
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ60410%27 HTTP/1.1" 200 None
2026-03-28 07:38:02 [auto1.de] INFO: Scrape type for GZ60410: 0
2026-03-28 07:38:02 [auto1.de] INFO: Found listing with ID: SS89558
2026-03-28 07:38:02 [auto1.de] INFO: Found listing with ID: VA48219
2026-03-28 07:38:02 [auto1.de] INFO: Found listing with ID: NA97113
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA97113%27 HTTP/1.1" 200 None
2026-03-28 07:38:02 [auto1.de] INFO: Scrape type for NA97113: 0
2026-03-28 07:38:02 [auto1.de] INFO: Found listing with ID: KU60138
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU60138%27 HTTP/1.1" 200 None
2026-03-28 07:38:02 [auto1.de] INFO: Scrape type for KU60138: 0
2026-03-28 07:38:02 [auto1.de] INFO: Found listing with ID: LP87124
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP87124%27 HTTP/1.1" 200 None
2026-03-28 07:38:02 [auto1.de] INFO: Scrape type for LP87124: 2
2026-03-28 07:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d23e60bf-cdfe-5f1c-8ff9-3d7dd6470ded with identifier: LP87124
2026-03-28 07:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d23e60bf-cdfe-5f1c-8ff9-3d7dd6470ded with scrape type 2
2026-03-28 07:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d23e60bf-cdfe-5f1c-8ff9-3d7dd6470ded with scrape type 2
2026-03-28 07:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d23e60bf-cdfe-5f1c-8ff9-3d7dd6470ded, identifier: LP87124
2026-03-28 07:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d23e60bf-cdfe-5f1c-8ff9-3d7dd6470ded with identifier: LP87124
2026-03-28 07:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d23e60bf-cdfe-5f1c-8ff9-3d7dd6470ded with identifier: LP87124
2026-03-28 07:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d23e60bf-cdfe-5f1c-8ff9-3d7dd6470ded with identifier: LP87124 to the API
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:28:44Z',
'fuel_type': 'diesel',
'id': 'd23e60bf-cdfe-5f1c-8ff9-3d7dd6470ded',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP87124',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 227818,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-20',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2017}
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP87124%27 HTTP/1.1" 200 None
2026-03-28 07:38:02 [auto1.de] INFO: Saving data for LP87124: {'auction_closing_time': 1774715324.0, 'created_time': 1773860708.541298, 'last_price_update_time': 1774683482.808183}
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LP87124') HTTP/1.1" 204 0
2026-03-28 07:38:02 [auto1.de] INFO: Found listing with ID: MH16852
2026-03-28 07:38:02 [auto1.de] INFO: Found listing with ID: NJ99986
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ99986%27 HTTP/1.1" 200 None
2026-03-28 07:38:02 [auto1.de] INFO: Scrape type for NJ99986: 0
2026-03-28 07:38:02 [auto1.de] INFO: Found listing with ID: HS66299
2026-03-28 07:38:02 [auto1.de] INFO: Found listing with ID: XH30445
2026-03-28 07:38:02 [auto1.de] INFO: Found listing with ID: PM30121
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM30121%27 HTTP/1.1" 200 None
2026-03-28 07:38:02 [auto1.de] INFO: Scrape type for PM30121: 0
2026-03-28 07:38:02 [auto1.de] INFO: Found listing with ID: CU41994
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU41994%27 HTTP/1.1" 200 None
2026-03-28 07:38:02 [auto1.de] INFO: Scrape type for CU41994: 0
2026-03-28 07:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:38:03 [auto1.de] INFO: Channel: 24h | Page: 95 | totalHits: 9257 | hits on page: 40
2026-03-28 07:38:03 [auto1.de] INFO: Found listing with ID: ZZ39888
2026-03-28 07:38:03 [auto1.de] INFO: Found listing with ID: DP83508
2026-03-28 07:38:03 [auto1.de] INFO: Found listing with ID: AJ12624
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ12624%27 HTTP/1.1" 200 None
2026-03-28 07:38:03 [auto1.de] INFO: Scrape type for AJ12624: 0
2026-03-28 07:38:03 [auto1.de] INFO: Found listing with ID: EU54911
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU54911%27 HTTP/1.1" 200 None
2026-03-28 07:38:03 [auto1.de] INFO: Scrape type for EU54911: 0
2026-03-28 07:38:03 [auto1.de] INFO: Found listing with ID: JE14755
2026-03-28 07:38:03 [auto1.de] INFO: Found listing with ID: XN43654
2026-03-28 07:38:03 [auto1.de] INFO: Found listing with ID: XE32981
2026-03-28 07:38:03 [auto1.de] INFO: Found listing with ID: CP06535
2026-03-28 07:38:03 [auto1.de] INFO: Found listing with ID: RU00171
2026-03-28 07:38:03 [auto1.de] INFO: Found listing with ID: FB69161
2026-03-28 07:38:03 [auto1.de] INFO: Found listing with ID: XB90815
2026-03-28 07:38:03 [auto1.de] INFO: Found listing with ID: GC12583
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC12583%27 HTTP/1.1" 200 None
2026-03-28 07:38:03 [auto1.de] INFO: Scrape type for GC12583: 0
2026-03-28 07:38:03 [auto1.de] INFO: Found listing with ID: CM42971
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM42971%27 HTTP/1.1" 200 None
2026-03-28 07:38:03 [auto1.de] INFO: Scrape type for CM42971: 0
2026-03-28 07:38:03 [auto1.de] INFO: Found listing with ID: FG94497
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG94497%27 HTTP/1.1" 200 None
2026-03-28 07:38:03 [auto1.de] INFO: Scrape type for FG94497: 0
2026-03-28 07:38:03 [auto1.de] INFO: Found listing with ID: MJ25721
2026-03-28 07:38:03 [auto1.de] INFO: Found listing with ID: YT56915
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT56915%27 HTTP/1.1" 200 None
2026-03-28 07:38:03 [auto1.de] INFO: Scrape type for YT56915: 0
2026-03-28 07:38:03 [auto1.de] INFO: Found listing with ID: VH62706
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH62706%27 HTTP/1.1" 200 None
2026-03-28 07:38:03 [auto1.de] INFO: Scrape type for VH62706: 0
2026-03-28 07:38:03 [auto1.de] INFO: Found listing with ID: MG11664
2026-03-28 07:38:03 [auto1.de] INFO: Found listing with ID: NV18768
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV18768%27 HTTP/1.1" 200 None
2026-03-28 07:38:03 [auto1.de] INFO: Scrape type for NV18768: 2
2026-03-28 07:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 563c91ef-25a0-5c61-ba64-d7a520604029 with identifier: NV18768
2026-03-28 07:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 563c91ef-25a0-5c61-ba64-d7a520604029 with scrape type 2
2026-03-28 07:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 563c91ef-25a0-5c61-ba64-d7a520604029 with scrape type 2
2026-03-28 07:38:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 563c91ef-25a0-5c61-ba64-d7a520604029, identifier: NV18768
2026-03-28 07:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 563c91ef-25a0-5c61-ba64-d7a520604029 with identifier: NV18768
2026-03-28 07:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 563c91ef-25a0-5c61-ba64-d7a520604029 with identifier: NV18768
2026-03-28 07:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 563c91ef-25a0-5c61-ba64-d7a520604029 with identifier: NV18768 to the API
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:42:08Z',
'fuel_type': 'diesel',
'id': '563c91ef-25a0-5c61-ba64-d7a520604029',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV18768',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Viano',
'odometer': 259886,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-11-08',
'seller_name': None,
'title': 'Mercedes-Benz Viano 3.0 CDI lang Trend Activity',
'transmission': 'automatic',
'trim': 'lang Trend Activity',
'year': 2007}
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV18768%27 HTTP/1.1" 200 None
2026-03-28 07:38:03 [auto1.de] INFO: Saving data for NV18768: {'auction_closing_time': 1774716128.0, 'created_time': 1774465275.299785, 'last_price_update_time': 1774683483.807013}
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV18768') HTTP/1.1" 204 0
2026-03-28 07:38:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:38:03 [auto1.de] INFO: Found listing with ID: HM06155
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM06155%27 HTTP/1.1" 200 None
2026-03-28 07:38:03 [auto1.de] INFO: Scrape type for HM06155: 0
2026-03-28 07:38:03 [auto1.de] INFO: Found listing with ID: SP10059
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP10059%27 HTTP/1.1" 200 None
2026-03-28 07:38:03 [auto1.de] INFO: Scrape type for SP10059: 0
2026-03-28 07:38:03 [auto1.de] INFO: Found listing with ID: JL52757
2026-03-28 07:38:03 [auto1.de] INFO: Found listing with ID: YW69752
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW69752%27 HTTP/1.1" 200 None
2026-03-28 07:38:03 [auto1.de] INFO: Scrape type for YW69752: 2
2026-03-28 07:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41bbfb6d-298c-5108-abda-0cd207a9a6cf with identifier: YW69752
2026-03-28 07:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41bbfb6d-298c-5108-abda-0cd207a9a6cf with scrape type 2
2026-03-28 07:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41bbfb6d-298c-5108-abda-0cd207a9a6cf with scrape type 2
2026-03-28 07:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41bbfb6d-298c-5108-abda-0cd207a9a6cf, identifier: YW69752
2026-03-28 07:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41bbfb6d-298c-5108-abda-0cd207a9a6cf with identifier: YW69752
2026-03-28 07:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41bbfb6d-298c-5108-abda-0cd207a9a6cf with identifier: YW69752
2026-03-28 07:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41bbfb6d-298c-5108-abda-0cd207a9a6cf with identifier: YW69752 to the API
2026-03-28 07:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:24:30Z',
'fuel_type': 'diesel',
'id': '41bbfb6d-298c-5108-abda-0cd207a9a6cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW69752',
'listing': 'auction',
'make': 'Ford',
'model': 'Grand Tourneo Connect',
'odometer': 254520,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-18',
'seller_name': None,
'title': 'Ford Grand Tourneo Connect 1.6 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2014}
2026-03-28 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW69752%27 HTTP/1.1" 200 None
2026-03-28 07:38:04 [auto1.de] INFO: Saving data for YW69752: {'auction_closing_time': 1774715070.0, 'created_time': 1774467208.132557, 'last_price_update_time': 1774683484.403959}
2026-03-28 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW69752') HTTP/1.1" 204 0
2026-03-28 07:38:04 [auto1.de] INFO: Found listing with ID: RX80548
2026-03-28 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX80548%27 HTTP/1.1" 200 None
2026-03-28 07:38:04 [auto1.de] INFO: Scrape type for RX80548: 0
2026-03-28 07:38:04 [auto1.de] INFO: Found listing with ID: MH48828
2026-03-28 07:38:04 [auto1.de] INFO: Found listing with ID: RJ91019
2026-03-28 07:38:04 [auto1.de] INFO: Found listing with ID: PM11705
2026-03-28 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM11705%27 HTTP/1.1" 200 None
2026-03-28 07:38:04 [auto1.de] INFO: Scrape type for PM11705: 2
2026-03-28 07:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb074bbe-1222-58fe-87bb-04d3b0246eb9 with identifier: PM11705
2026-03-28 07:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb074bbe-1222-58fe-87bb-04d3b0246eb9 with scrape type 2
2026-03-28 07:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb074bbe-1222-58fe-87bb-04d3b0246eb9 with scrape type 2
2026-03-28 07:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb074bbe-1222-58fe-87bb-04d3b0246eb9, identifier: PM11705
2026-03-28 07:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb074bbe-1222-58fe-87bb-04d3b0246eb9 with identifier: PM11705
2026-03-28 07:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb074bbe-1222-58fe-87bb-04d3b0246eb9 with identifier: PM11705
2026-03-28 07:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb074bbe-1222-58fe-87bb-04d3b0246eb9 with identifier: PM11705 to the API
2026-03-28 07:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:02:45Z',
'fuel_type': 'diesel',
'id': 'fb074bbe-1222-58fe-87bb-04d3b0246eb9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM11705',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 155932,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-31',
'seller_name': None,
'title': 'Peugeot Expert 1.5 Blue-HDi Pro L1',
'transmission': 'manual',
'trim': 'Pro L1',
'year': 2020}
2026-03-28 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM11705%27 HTTP/1.1" 200 None
2026-03-28 07:38:04 [auto1.de] INFO: Saving data for PM11705: {'auction_closing_time': 1774713765.0, 'created_time': 1774468178.409149, 'last_price_update_time': 1774683484.844556}
2026-03-28 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PM11705') HTTP/1.1" 204 0
2026-03-28 07:38:04 [auto1.de] INFO: Found listing with ID: NW48345
2026-03-28 07:38:04 [auto1.de] INFO: Found listing with ID: CC77808
2026-03-28 07:38:04 [auto1.de] INFO: Found listing with ID: AJ11776
2026-03-28 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ11776%27 HTTP/1.1" 200 None
2026-03-28 07:38:04 [auto1.de] INFO: Scrape type for AJ11776: 0
2026-03-28 07:38:04 [auto1.de] INFO: Found listing with ID: CC84922
2026-03-28 07:38:04 [auto1.de] INFO: Found listing with ID: RS45157
2026-03-28 07:38:04 [auto1.de] INFO: Found listing with ID: CS22727
2026-03-28 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS22727%27 HTTP/1.1" 200 None
2026-03-28 07:38:04 [auto1.de] INFO: Scrape type for CS22727: 0
2026-03-28 07:38:04 [auto1.de] INFO: Found listing with ID: DF33717
2026-03-28 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF33717%27 HTTP/1.1" 200 None
2026-03-28 07:38:04 [auto1.de] INFO: Scrape type for DF33717: 0
2026-03-28 07:38:04 [auto1.de] INFO: Found listing with ID: HT55645
2026-03-28 07:38:04 [auto1.de] INFO: Found listing with ID: TJ17702
2026-03-28 07:38:04 [auto1.de] INFO: Found listing with ID: WX42639
2026-03-28 07:38:04 [auto1.de] INFO: Found listing with ID: TE00128
2026-03-28 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE00128%27 HTTP/1.1" 200 None
2026-03-28 07:38:04 [auto1.de] INFO: Scrape type for TE00128: 2
2026-03-28 07:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21d4372d-6025-5e8f-8e9d-04da3abb0e8e with identifier: TE00128
2026-03-28 07:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21d4372d-6025-5e8f-8e9d-04da3abb0e8e with scrape type 2
2026-03-28 07:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21d4372d-6025-5e8f-8e9d-04da3abb0e8e with scrape type 2
2026-03-28 07:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21d4372d-6025-5e8f-8e9d-04da3abb0e8e, identifier: TE00128
2026-03-28 07:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21d4372d-6025-5e8f-8e9d-04da3abb0e8e with identifier: TE00128
2026-03-28 07:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21d4372d-6025-5e8f-8e9d-04da3abb0e8e with identifier: TE00128
2026-03-28 07:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21d4372d-6025-5e8f-8e9d-04da3abb0e8e with identifier: TE00128 to the API
2026-03-28 07:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:45:43Z',
'fuel_type': 'petrol',
'id': '21d4372d-6025-5e8f-8e9d-04da3abb0e8e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE00128',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 144233,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-29',
'seller_name': None,
'title': 'Audi A3 Sportback 1.2 TFSI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2011}
2026-03-28 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE00128%27 HTTP/1.1" 200 None
2026-03-28 07:38:05 [auto1.de] INFO: Saving data for TE00128: {'auction_closing_time': 1774716343.0, 'created_time': 1774468113.905414, 'last_price_update_time': 1774683485.322896}
2026-03-28 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE00128') HTTP/1.1" 204 0
2026-03-28 07:38:05 [auto1.de] INFO: Found listing with ID: BX62437
2026-03-28 07:38:05 [auto1.de] INFO: Found listing with ID: EH89058
2026-03-28 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH89058%27 HTTP/1.1" 200 None
2026-03-28 07:38:05 [auto1.de] INFO: Scrape type for EH89058: 0
2026-03-28 07:38:06 [scrapy.extensions.logstats] INFO: Crawled 101 pages (at 12 pages/min), scraped 385 items (at 52 items/min)
2026-03-28 07:38:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 165MiB
2026-03-28 07:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:38:06 [auto1.de] INFO: Channel: 24h | Page: 96 | totalHits: 9257 | hits on page: 40
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: HW71141
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW71141%27 HTTP/1.1" 200 None
2026-03-28 07:38:06 [auto1.de] INFO: Scrape type for HW71141: 0
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: FG01299
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: HV92794
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: FE62159
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: XZ20082
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: VC16092
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: AZ20598
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: HM95018
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM95018%27 HTTP/1.1" 200 None
2026-03-28 07:38:06 [auto1.de] INFO: Scrape type for HM95018: 0
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: PK12624
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: TN09859
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN09859%27 HTTP/1.1" 200 None
2026-03-28 07:38:06 [auto1.de] INFO: Scrape type for TN09859: 0
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: DE54360
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: JT09686
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT09686%27 HTTP/1.1" 200 None
2026-03-28 07:38:06 [auto1.de] INFO: Scrape type for JT09686: 0
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: NU64349
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: MA95154
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA95154%27 HTTP/1.1" 200 None
2026-03-28 07:38:06 [auto1.de] INFO: Scrape type for MA95154: 0
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: VM08251
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: ZA27483
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA27483%27 HTTP/1.1" 200 None
2026-03-28 07:38:06 [auto1.de] INFO: Scrape type for ZA27483: 0
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: BF92726
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: SV97177
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: LS85848
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: MA92552
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: ND90067
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: WV31181
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV31181%27 HTTP/1.1" 200 None
2026-03-28 07:38:06 [auto1.de] INFO: Scrape type for WV31181: 0
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: WP06272
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: NV65753
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: US20964
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: YP19637
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: GG55912
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG55912%27 HTTP/1.1" 200 None
2026-03-28 07:38:06 [auto1.de] INFO: Scrape type for GG55912: 0
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: LE07247
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE07247%27 HTTP/1.1" 200 None
2026-03-28 07:38:06 [auto1.de] INFO: Scrape type for LE07247: 0
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: GM00936
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM00936%27 HTTP/1.1" 200 None
2026-03-28 07:38:06 [auto1.de] INFO: Scrape type for GM00936: 0
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: KE58425
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE58425%27 HTTP/1.1" 200 None
2026-03-28 07:38:06 [auto1.de] INFO: Scrape type for KE58425: 0
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: EB96923
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB96923%27 HTTP/1.1" 200 None
2026-03-28 07:38:06 [auto1.de] INFO: Scrape type for EB96923: 0
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: UC67587
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: MT37929
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT37929%27 HTTP/1.1" 200 None
2026-03-28 07:38:06 [auto1.de] INFO: Scrape type for MT37929: 0
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: NN70157
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN70157%27 HTTP/1.1" 200 None
2026-03-28 07:38:06 [auto1.de] INFO: Scrape type for NN70157: 0
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: JB33429
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: PB76080
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB76080%27 HTTP/1.1" 200 None
2026-03-28 07:38:06 [auto1.de] INFO: Scrape type for PB76080: 0
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: ZZ70410
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ70410%27 HTTP/1.1" 200 None
2026-03-28 07:38:06 [auto1.de] INFO: Scrape type for ZZ70410: 0
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: MB01512
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB01512%27 HTTP/1.1" 200 None
2026-03-28 07:38:06 [auto1.de] INFO: Scrape type for MB01512: 0
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: JE38755
2026-03-28 07:38:06 [auto1.de] INFO: Found listing with ID: KH41700
2026-03-28 07:38:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:38:23 [auto1.de] INFO: Channel: 24h | Page: 97 | totalHits: 9258 | hits on page: 40
2026-03-28 07:38:23 [auto1.de] INFO: Found listing with ID: KH41700
2026-03-28 07:38:23 [auto1.de] INFO: Found listing with ID: WG75781
2026-03-28 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG75781%27 HTTP/1.1" 200 None
2026-03-28 07:38:23 [auto1.de] INFO: Scrape type for WG75781: 0
2026-03-28 07:38:23 [auto1.de] INFO: Found listing with ID: DL07796
2026-03-28 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL07796%27 HTTP/1.1" 200 None
2026-03-28 07:38:23 [auto1.de] INFO: Scrape type for DL07796: 0
2026-03-28 07:38:23 [auto1.de] INFO: Found listing with ID: ZW75307
2026-03-28 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW75307%27 HTTP/1.1" 200 None
2026-03-28 07:38:23 [auto1.de] INFO: Scrape type for ZW75307: 0
2026-03-28 07:38:23 [auto1.de] INFO: Found listing with ID: KM43405
2026-03-28 07:38:23 [auto1.de] INFO: Found listing with ID: XZ94866
2026-03-28 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ94866%27 HTTP/1.1" 200 None
2026-03-28 07:38:23 [auto1.de] INFO: Scrape type for XZ94866: 0
2026-03-28 07:38:23 [auto1.de] INFO: Found listing with ID: EC14916
2026-03-28 07:38:23 [auto1.de] INFO: Found listing with ID: AG38936
2026-03-28 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG38936%27 HTTP/1.1" 200 None
2026-03-28 07:38:23 [auto1.de] INFO: Scrape type for AG38936: 0
2026-03-28 07:38:23 [auto1.de] INFO: Found listing with ID: RU20217
2026-03-28 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU20217%27 HTTP/1.1" 200 None
2026-03-28 07:38:23 [auto1.de] INFO: Scrape type for RU20217: 2
2026-03-28 07:38:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f144c24-ac52-56f4-99d0-a2a97518fae2 with identifier: RU20217
2026-03-28 07:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f144c24-ac52-56f4-99d0-a2a97518fae2 with scrape type 2
2026-03-28 07:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f144c24-ac52-56f4-99d0-a2a97518fae2 with scrape type 2
2026-03-28 07:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f144c24-ac52-56f4-99d0-a2a97518fae2, identifier: RU20217
2026-03-28 07:38:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f144c24-ac52-56f4-99d0-a2a97518fae2 with identifier: RU20217
2026-03-28 07:38:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f144c24-ac52-56f4-99d0-a2a97518fae2 with identifier: RU20217
2026-03-28 07:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f144c24-ac52-56f4-99d0-a2a97518fae2 with identifier: RU20217 to the API
2026-03-28 07:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:56:42Z',
'fuel_type': 'petrol',
'id': '7f144c24-ac52-56f4-99d0-a2a97518fae2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU20217',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 82993,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-29',
'seller_name': None,
'title': 'Opel Mokka X 1.4 Turbo Selection Start/Stop',
'transmission': 'manual',
'trim': 'Selection Start/Stop',
'year': 2018}
2026-03-28 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU20217%27 HTTP/1.1" 200 None
2026-03-28 07:38:23 [auto1.de] INFO: Saving data for RU20217: {'auction_closing_time': 1774717002.0, 'created_time': 1773860263.123435, 'last_price_update_time': 1774683503.973238}
2026-03-28 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU20217') HTTP/1.1" 204 0
2026-03-28 07:38:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:38:24 [auto1.de] INFO: Found listing with ID: BK73994
2026-03-28 07:38:24 [auto1.de] INFO: Found listing with ID: DZ61875
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ61875%27 HTTP/1.1" 200 None
2026-03-28 07:38:24 [auto1.de] INFO: Scrape type for DZ61875: 0
2026-03-28 07:38:24 [auto1.de] INFO: Found listing with ID: LC23112
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC23112%27 HTTP/1.1" 200 None
2026-03-28 07:38:24 [auto1.de] INFO: Scrape type for LC23112: 0
2026-03-28 07:38:24 [auto1.de] INFO: Found listing with ID: RH56837
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH56837%27 HTTP/1.1" 200 None
2026-03-28 07:38:24 [auto1.de] INFO: Scrape type for RH56837: 0
2026-03-28 07:38:24 [auto1.de] INFO: Found listing with ID: CW66506
2026-03-28 07:38:24 [auto1.de] INFO: Found listing with ID: TD56842
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD56842%27 HTTP/1.1" 200 None
2026-03-28 07:38:24 [auto1.de] INFO: Scrape type for TD56842: 0
2026-03-28 07:38:24 [auto1.de] INFO: Found listing with ID: PL23541
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL23541%27 HTTP/1.1" 200 None
2026-03-28 07:38:24 [auto1.de] INFO: Scrape type for PL23541: 0
2026-03-28 07:38:24 [auto1.de] INFO: Found listing with ID: LG97713
2026-03-28 07:38:24 [auto1.de] INFO: Found listing with ID: NH37075
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH37075%27 HTTP/1.1" 200 None
2026-03-28 07:38:24 [auto1.de] INFO: Scrape type for NH37075: 0
2026-03-28 07:38:24 [auto1.de] INFO: Found listing with ID: GT54130
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT54130%27 HTTP/1.1" 200 None
2026-03-28 07:38:24 [auto1.de] INFO: Scrape type for GT54130: 0
2026-03-28 07:38:24 [auto1.de] INFO: Found listing with ID: XP46424
2026-03-28 07:38:24 [auto1.de] INFO: Found listing with ID: FM24732
2026-03-28 07:38:24 [auto1.de] INFO: Found listing with ID: UC67308
2026-03-28 07:38:24 [auto1.de] INFO: Found listing with ID: LB09285
2026-03-28 07:38:24 [auto1.de] INFO: Found listing with ID: RL82017
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL82017%27 HTTP/1.1" 200 None
2026-03-28 07:38:24 [auto1.de] INFO: Scrape type for RL82017: 2
2026-03-28 07:38:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5edf5909-c31d-554a-a8a2-6e5507572b57 with identifier: RL82017
2026-03-28 07:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5edf5909-c31d-554a-a8a2-6e5507572b57 with scrape type 2
2026-03-28 07:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5edf5909-c31d-554a-a8a2-6e5507572b57 with scrape type 2
2026-03-28 07:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5edf5909-c31d-554a-a8a2-6e5507572b57, identifier: RL82017
2026-03-28 07:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5edf5909-c31d-554a-a8a2-6e5507572b57 with identifier: RL82017
2026-03-28 07:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5edf5909-c31d-554a-a8a2-6e5507572b57 with identifier: RL82017
2026-03-28 07:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5edf5909-c31d-554a-a8a2-6e5507572b57 with identifier: RL82017 to the API
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:26:29Z',
'fuel_type': 'diesel',
'id': '5edf5909-c31d-554a-a8a2-6e5507572b57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL82017',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'V-Klasse',
'odometer': 124533,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-22',
'seller_name': None,
'title': 'Mercedes-Benz V-Klasse V 250 d lang',
'transmission': 'automatic',
'trim': 'lang',
'year': 2017}
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL82017%27 HTTP/1.1" 200 None
2026-03-28 07:38:24 [auto1.de] INFO: Saving data for RL82017: {'auction_closing_time': 1774715189.0, 'created_time': 1774468101.538439, 'last_price_update_time': 1774683504.640935}
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL82017') HTTP/1.1" 204 0
2026-03-28 07:38:24 [auto1.de] INFO: Found listing with ID: RE74325
2026-03-28 07:38:24 [auto1.de] INFO: Found listing with ID: CS13699
2026-03-28 07:38:24 [auto1.de] INFO: Found listing with ID: AC78646
2026-03-28 07:38:24 [auto1.de] INFO: Found listing with ID: SA50642
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA50642%27 HTTP/1.1" 200 None
2026-03-28 07:38:24 [auto1.de] INFO: Scrape type for SA50642: 0
2026-03-28 07:38:24 [auto1.de] INFO: Found listing with ID: JT67031
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT67031%27 HTTP/1.1" 200 None
2026-03-28 07:38:24 [auto1.de] INFO: Scrape type for JT67031: 0
2026-03-28 07:38:24 [auto1.de] INFO: Found listing with ID: WT87490
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT87490%27 HTTP/1.1" 200 None
2026-03-28 07:38:24 [auto1.de] INFO: Scrape type for WT87490: 2
2026-03-28 07:38:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fae2c75f-6cae-510d-916f-5698ff2d85ce with identifier: WT87490
2026-03-28 07:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fae2c75f-6cae-510d-916f-5698ff2d85ce with scrape type 2
2026-03-28 07:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fae2c75f-6cae-510d-916f-5698ff2d85ce with scrape type 2
2026-03-28 07:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fae2c75f-6cae-510d-916f-5698ff2d85ce, identifier: WT87490
2026-03-28 07:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fae2c75f-6cae-510d-916f-5698ff2d85ce with identifier: WT87490
2026-03-28 07:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fae2c75f-6cae-510d-916f-5698ff2d85ce with identifier: WT87490
2026-03-28 07:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fae2c75f-6cae-510d-916f-5698ff2d85ce with identifier: WT87490 to the API
2026-03-28 07:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:40:01Z',
'fuel_type': 'diesel',
'id': 'fae2c75f-6cae-510d-916f-5698ff2d85ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT87490',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 137639,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-30',
'seller_name': None,
'title': 'BMW 2er 220d Active Tourer Sport Line',
'transmission': 'automatic',
'trim': 'Sport Line',
'year': 2015}
2026-03-28 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT87490%27 HTTP/1.1" 200 None
2026-03-28 07:38:25 [auto1.de] INFO: Saving data for WT87490: {'auction_closing_time': 1774716001.0, 'created_time': 1774464651.837133, 'last_price_update_time': 1774683505.201285}
2026-03-28 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT87490') HTTP/1.1" 204 0
2026-03-28 07:38:25 [auto1.de] INFO: Found listing with ID: LS17715
2026-03-28 07:38:25 [auto1.de] INFO: Found listing with ID: AZ58179
2026-03-28 07:38:25 [auto1.de] INFO: Found listing with ID: LY90714
2026-03-28 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY90714%27 HTTP/1.1" 200 None
2026-03-28 07:38:25 [auto1.de] INFO: Scrape type for LY90714: 0
2026-03-28 07:38:25 [auto1.de] INFO: Found listing with ID: DF13757
2026-03-28 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF13757%27 HTTP/1.1" 200 None
2026-03-28 07:38:25 [auto1.de] INFO: Scrape type for DF13757: 0
2026-03-28 07:38:25 [auto1.de] INFO: Found listing with ID: HH97697
2026-03-28 07:38:25 [auto1.de] INFO: Found listing with ID: AA51268
2026-03-28 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA51268%27 HTTP/1.1" 200 None
2026-03-28 07:38:25 [auto1.de] INFO: Scrape type for AA51268: 0
2026-03-28 07:38:25 [auto1.de] INFO: Found listing with ID: UY74953
2026-03-28 07:38:25 [auto1.de] INFO: Found listing with ID: JZ29670
2026-03-28 07:38:25 [auto1.de] INFO: Found listing with ID: UM78498
2026-03-28 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM78498%27 HTTP/1.1" 200 None
2026-03-28 07:38:25 [auto1.de] INFO: Scrape type for UM78498: 0
2026-03-28 07:38:25 [auto1.de] INFO: Found listing with ID: UJ05143
2026-03-28 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ05143%27 HTTP/1.1" 200 None
2026-03-28 07:38:25 [auto1.de] INFO: Scrape type for UJ05143: 0
2026-03-28 07:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:38:26 [auto1.de] INFO: Channel: 24h | Page: 98 | totalHits: 9258 | hits on page: 40
2026-03-28 07:38:26 [auto1.de] INFO: Found listing with ID: GS82653
2026-03-28 07:38:26 [auto1.de] INFO: Found listing with ID: PE27175
2026-03-28 07:38:26 [auto1.de] INFO: Found listing with ID: AZ40865
2026-03-28 07:38:26 [auto1.de] INFO: Found listing with ID: EU79634
2026-03-28 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU79634%27 HTTP/1.1" 200 None
2026-03-28 07:38:26 [auto1.de] INFO: Scrape type for EU79634: 0
2026-03-28 07:38:26 [auto1.de] INFO: Found listing with ID: RY54075
2026-03-28 07:38:26 [auto1.de] INFO: Found listing with ID: ZX49243
2026-03-28 07:38:26 [auto1.de] INFO: Found listing with ID: SH34728
2026-03-28 07:38:26 [auto1.de] INFO: Found listing with ID: ZZ68403
2026-03-28 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ68403%27 HTTP/1.1" 200 None
2026-03-28 07:38:26 [auto1.de] INFO: Scrape type for ZZ68403: 0
2026-03-28 07:38:26 [auto1.de] INFO: Found listing with ID: SZ88186
2026-03-28 07:38:26 [auto1.de] INFO: Found listing with ID: DL39221
2026-03-28 07:38:26 [auto1.de] INFO: Found listing with ID: WZ31189
2026-03-28 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ31189%27 HTTP/1.1" 200 None
2026-03-28 07:38:26 [auto1.de] INFO: Scrape type for WZ31189: 0
2026-03-28 07:38:26 [auto1.de] INFO: Found listing with ID: RS00302
2026-03-28 07:38:26 [auto1.de] INFO: Found listing with ID: TU46947
2026-03-28 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU46947%27 HTTP/1.1" 200 None
2026-03-28 07:38:26 [auto1.de] INFO: Scrape type for TU46947: 0
2026-03-28 07:38:26 [auto1.de] INFO: Found listing with ID: VV79476
2026-03-28 07:38:26 [auto1.de] INFO: Found listing with ID: DN68550
2026-03-28 07:38:26 [auto1.de] INFO: Found listing with ID: JW69458
2026-03-28 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW69458%27 HTTP/1.1" 200 None
2026-03-28 07:38:26 [auto1.de] INFO: Scrape type for JW69458: 2
2026-03-28 07:38:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e5d4e21-2462-5bf2-ace1-832b3890f089 with identifier: JW69458
2026-03-28 07:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e5d4e21-2462-5bf2-ace1-832b3890f089 with scrape type 2
2026-03-28 07:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e5d4e21-2462-5bf2-ace1-832b3890f089 with scrape type 2
2026-03-28 07:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e5d4e21-2462-5bf2-ace1-832b3890f089, identifier: JW69458
2026-03-28 07:38:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e5d4e21-2462-5bf2-ace1-832b3890f089 with identifier: JW69458
2026-03-28 07:38:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e5d4e21-2462-5bf2-ace1-832b3890f089 with identifier: JW69458
2026-03-28 07:38:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e5d4e21-2462-5bf2-ace1-832b3890f089 with identifier: JW69458 to the API
2026-03-28 07:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:36:17Z',
'fuel_type': 'petrol',
'id': '2e5d4e21-2462-5bf2-ace1-832b3890f089',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW69458',
'listing': 'auction',
'make': 'Skoda',
'model': 'Yeti',
'odometer': 189070,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-12',
'seller_name': None,
'title': 'Skoda Yeti 1.4 TSI Monte Carlo',
'transmission': 'automatic',
'trim': 'Monte Carlo',
'year': 2015}
2026-03-28 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW69458%27 HTTP/1.1" 200 None
2026-03-28 07:38:26 [auto1.de] INFO: Saving data for JW69458: {'auction_closing_time': 1774715777.0, 'created_time': 1774465061.614417, 'last_price_update_time': 1774683506.88677}
2026-03-28 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JW69458') HTTP/1.1" 204 0
2026-03-28 07:38:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:38:27 [auto1.de] INFO: Found listing with ID: SC69057
2026-03-28 07:38:27 [auto1.de] INFO: Found listing with ID: ST98155
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST98155%27 HTTP/1.1" 200 None
2026-03-28 07:38:27 [auto1.de] INFO: Scrape type for ST98155: 0
2026-03-28 07:38:27 [auto1.de] INFO: Found listing with ID: CR90100
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR90100%27 HTTP/1.1" 200 None
2026-03-28 07:38:27 [auto1.de] INFO: Scrape type for CR90100: 0
2026-03-28 07:38:27 [auto1.de] INFO: Found listing with ID: VW19119
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW19119%27 HTTP/1.1" 200 None
2026-03-28 07:38:27 [auto1.de] INFO: Scrape type for VW19119: 0
2026-03-28 07:38:27 [auto1.de] INFO: Found listing with ID: GL29302
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL29302%27 HTTP/1.1" 200 None
2026-03-28 07:38:27 [auto1.de] INFO: Scrape type for GL29302: 0
2026-03-28 07:38:27 [auto1.de] INFO: Found listing with ID: HX20102
2026-03-28 07:38:27 [auto1.de] INFO: Found listing with ID: LS81640
2026-03-28 07:38:27 [auto1.de] INFO: Found listing with ID: HG98131
2026-03-28 07:38:27 [auto1.de] INFO: Found listing with ID: AE08080
2026-03-28 07:38:27 [auto1.de] INFO: Found listing with ID: KY67779
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY67779%27 HTTP/1.1" 200 None
2026-03-28 07:38:27 [auto1.de] INFO: Scrape type for KY67779: 0
2026-03-28 07:38:27 [auto1.de] INFO: Found listing with ID: JU56361
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU56361%27 HTTP/1.1" 200 None
2026-03-28 07:38:27 [auto1.de] INFO: Scrape type for JU56361: 2
2026-03-28 07:38:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 794df1e3-4ef8-5637-82c5-b6dcf89902b0 with identifier: JU56361
2026-03-28 07:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 794df1e3-4ef8-5637-82c5-b6dcf89902b0 with scrape type 2
2026-03-28 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 794df1e3-4ef8-5637-82c5-b6dcf89902b0 with scrape type 2
2026-03-28 07:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 794df1e3-4ef8-5637-82c5-b6dcf89902b0, identifier: JU56361
2026-03-28 07:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 794df1e3-4ef8-5637-82c5-b6dcf89902b0 with identifier: JU56361
2026-03-28 07:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 794df1e3-4ef8-5637-82c5-b6dcf89902b0 with identifier: JU56361
2026-03-28 07:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 794df1e3-4ef8-5637-82c5-b6dcf89902b0 with identifier: JU56361 to the API
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:54:50Z',
'fuel_type': 'diesel',
'id': '794df1e3-4ef8-5637-82c5-b6dcf89902b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU56361',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 166976,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-25',
'seller_name': None,
'title': 'Audi Q3 2.0 TDI',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU56361%27 HTTP/1.1" 200 None
2026-03-28 07:38:27 [auto1.de] INFO: Saving data for JU56361: {'auction_closing_time': 1774716890.0, 'created_time': 1773860920.680729, 'last_price_update_time': 1774683507.597369}
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU56361') HTTP/1.1" 204 0
2026-03-28 07:38:27 [auto1.de] INFO: Found listing with ID: PK47596
2026-03-28 07:38:27 [auto1.de] INFO: Found listing with ID: PY46067
2026-03-28 07:38:27 [auto1.de] INFO: Found listing with ID: BJ29098
2026-03-28 07:38:27 [auto1.de] INFO: Found listing with ID: FW67106
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW67106%27 HTTP/1.1" 200 None
2026-03-28 07:38:27 [auto1.de] INFO: Scrape type for FW67106: 0
2026-03-28 07:38:27 [auto1.de] INFO: Found listing with ID: BF09730
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF09730%27 HTTP/1.1" 200 None
2026-03-28 07:38:27 [auto1.de] INFO: Scrape type for BF09730: 0
2026-03-28 07:38:27 [auto1.de] INFO: Found listing with ID: BG13362
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG13362%27 HTTP/1.1" 200 None
2026-03-28 07:38:27 [auto1.de] INFO: Scrape type for BG13362: 0
2026-03-28 07:38:27 [auto1.de] INFO: Found listing with ID: DB30141
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB30141%27 HTTP/1.1" 200 None
2026-03-28 07:38:27 [auto1.de] INFO: Scrape type for DB30141: 0
2026-03-28 07:38:27 [auto1.de] INFO: Found listing with ID: RF22787
2026-03-28 07:38:27 [auto1.de] INFO: Found listing with ID: HM53441
2026-03-28 07:38:27 [auto1.de] INFO: Found listing with ID: XW56933
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW56933%27 HTTP/1.1" 200 None
2026-03-28 07:38:27 [auto1.de] INFO: Scrape type for XW56933: 0
2026-03-28 07:38:27 [auto1.de] INFO: Found listing with ID: GW59315
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW59315%27 HTTP/1.1" 200 None
2026-03-28 07:38:27 [auto1.de] INFO: Scrape type for GW59315: 0
2026-03-28 07:38:27 [auto1.de] INFO: Found listing with ID: JT68679
2026-03-28 07:38:27 [auto1.de] INFO: Found listing with ID: UC16251
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC16251%27 HTTP/1.1" 200 None
2026-03-28 07:38:27 [auto1.de] INFO: Scrape type for UC16251: 0
2026-03-28 07:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:38:28 [auto1.de] INFO: Channel: 24h | Page: 99 | totalHits: 9258 | hits on page: 40
2026-03-28 07:38:28 [auto1.de] INFO: Found listing with ID: MT59111
2026-03-28 07:38:28 [auto1.de] INFO: Found listing with ID: DC50657
2026-03-28 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC50657%27 HTTP/1.1" 200 None
2026-03-28 07:38:28 [auto1.de] INFO: Scrape type for DC50657: 0
2026-03-28 07:38:28 [auto1.de] INFO: Found listing with ID: JH03969
2026-03-28 07:38:28 [auto1.de] INFO: Found listing with ID: JT24059
2026-03-28 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT24059%27 HTTP/1.1" 200 None
2026-03-28 07:38:28 [auto1.de] INFO: Scrape type for JT24059: 0
2026-03-28 07:38:28 [auto1.de] INFO: Found listing with ID: HZ59997
2026-03-28 07:38:28 [auto1.de] INFO: Found listing with ID: DN67284
2026-03-28 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN67284%27 HTTP/1.1" 200 None
2026-03-28 07:38:28 [auto1.de] INFO: Scrape type for DN67284: 0
2026-03-28 07:38:28 [auto1.de] INFO: Found listing with ID: SV23538
2026-03-28 07:38:28 [auto1.de] INFO: Found listing with ID: HB62696
2026-03-28 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB62696%27 HTTP/1.1" 200 None
2026-03-28 07:38:28 [auto1.de] INFO: Scrape type for HB62696: 0
2026-03-28 07:38:28 [auto1.de] INFO: Found listing with ID: VS07108
2026-03-28 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS07108%27 HTTP/1.1" 200 None
2026-03-28 07:38:28 [auto1.de] INFO: Scrape type for VS07108: 0
2026-03-28 07:38:28 [auto1.de] INFO: Found listing with ID: CV73589
2026-03-28 07:38:28 [auto1.de] INFO: Found listing with ID: RT49707
2026-03-28 07:38:28 [auto1.de] INFO: Found listing with ID: ND37325
2026-03-28 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND37325%27 HTTP/1.1" 200 None
2026-03-28 07:38:28 [auto1.de] INFO: Scrape type for ND37325: 2
2026-03-28 07:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69822d4f-8002-5b2f-9ec6-737ece637709 with identifier: ND37325
2026-03-28 07:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69822d4f-8002-5b2f-9ec6-737ece637709 with scrape type 2
2026-03-28 07:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69822d4f-8002-5b2f-9ec6-737ece637709 with scrape type 2
2026-03-28 07:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69822d4f-8002-5b2f-9ec6-737ece637709, identifier: ND37325
2026-03-28 07:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69822d4f-8002-5b2f-9ec6-737ece637709 with identifier: ND37325
2026-03-28 07:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69822d4f-8002-5b2f-9ec6-737ece637709 with identifier: ND37325
2026-03-28 07:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69822d4f-8002-5b2f-9ec6-737ece637709 with identifier: ND37325 to the API
2026-03-28 07:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:33:30Z',
'fuel_type': 'diesel',
'id': '69822d4f-8002-5b2f-9ec6-737ece637709',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND37325',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 232988,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-28',
'seller_name': None,
'title': 'Skoda Octavia 1.6 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2015}
2026-03-28 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND37325%27 HTTP/1.1" 200 None
2026-03-28 07:38:29 [auto1.de] INFO: Saving data for ND37325: {'auction_closing_time': 1774715610.0, 'created_time': 1774503053.30514, 'last_price_update_time': 1774683509.417542}
2026-03-28 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND37325') HTTP/1.1" 204 0
2026-03-28 07:38:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: DP75483
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: ED94101
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: HX17640
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: NU59007
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: AD58556
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: XW64211
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: HN56676
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: NK37699
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: HP87515
2026-03-28 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP87515%27 HTTP/1.1" 200 None
2026-03-28 07:38:29 [auto1.de] INFO: Scrape type for HP87515: 0
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: YT53234
2026-03-28 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT53234%27 HTTP/1.1" 200 None
2026-03-28 07:38:29 [auto1.de] INFO: Scrape type for YT53234: 0
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: UD93265
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: RE14454
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: DP99201
2026-03-28 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP99201%27 HTTP/1.1" 200 None
2026-03-28 07:38:29 [auto1.de] INFO: Scrape type for DP99201: 0
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: NY81856
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: BR35600
2026-03-28 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR35600%27 HTTP/1.1" 200 None
2026-03-28 07:38:29 [auto1.de] INFO: Scrape type for BR35600: 0
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: ZE88330
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: MC57954
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: KB55712
2026-03-28 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB55712%27 HTTP/1.1" 200 None
2026-03-28 07:38:29 [auto1.de] INFO: Scrape type for KB55712: 0
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: KG98772
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: RZ67048
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: MG85593
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: FB64910
2026-03-28 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB64910%27 HTTP/1.1" 200 None
2026-03-28 07:38:29 [auto1.de] INFO: Scrape type for FB64910: 0
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: KN24500
2026-03-28 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN24500%27 HTTP/1.1" 200 None
2026-03-28 07:38:29 [auto1.de] INFO: Scrape type for KN24500: 0
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: RU77143
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: CP51565
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: BE71150
2026-03-28 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE71150%27 HTTP/1.1" 200 None
2026-03-28 07:38:29 [auto1.de] INFO: Scrape type for BE71150: 0
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: GB40015
2026-03-28 07:38:29 [auto1.de] INFO: Found listing with ID: HJ82357
2026-03-28 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ82357%27 HTTP/1.1" 200 None
2026-03-28 07:38:29 [auto1.de] INFO: Scrape type for HJ82357: 0
2026-03-28 07:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:38:30 [auto1.de] INFO: Channel: 24h | Page: 100 | totalHits: 9258 | hits on page: 40
2026-03-28 07:38:30 [auto1.de] INFO: Found listing with ID: SS59240
2026-03-28 07:38:30 [auto1.de] INFO: Found listing with ID: UT59305
2026-03-28 07:38:30 [auto1.de] INFO: Found listing with ID: JK15259
2026-03-28 07:38:30 [auto1.de] INFO: Found listing with ID: RV63861
2026-03-28 07:38:30 [auto1.de] INFO: Found listing with ID: PL20844
2026-03-28 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL20844%27 HTTP/1.1" 200 None
2026-03-28 07:38:30 [auto1.de] INFO: Scrape type for PL20844: 0
2026-03-28 07:38:30 [auto1.de] INFO: Found listing with ID: ZG66499
2026-03-28 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG66499%27 HTTP/1.1" 200 None
2026-03-28 07:38:30 [auto1.de] INFO: Scrape type for ZG66499: 0
2026-03-28 07:38:30 [auto1.de] INFO: Found listing with ID: KJ96980
2026-03-28 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ96980%27 HTTP/1.1" 200 None
2026-03-28 07:38:30 [auto1.de] INFO: Scrape type for KJ96980: 0
2026-03-28 07:38:30 [auto1.de] INFO: Found listing with ID: KL17270
2026-03-28 07:38:30 [auto1.de] INFO: Found listing with ID: JV77194
2026-03-28 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV77194%27 HTTP/1.1" 200 None
2026-03-28 07:38:30 [auto1.de] INFO: Scrape type for JV77194: 2
2026-03-28 07:38:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 466b1101-b58d-541b-a86a-2c83fdd7efd2 with identifier: JV77194
2026-03-28 07:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 466b1101-b58d-541b-a86a-2c83fdd7efd2 with scrape type 2
2026-03-28 07:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 466b1101-b58d-541b-a86a-2c83fdd7efd2 with scrape type 2
2026-03-28 07:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 466b1101-b58d-541b-a86a-2c83fdd7efd2, identifier: JV77194
2026-03-28 07:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 466b1101-b58d-541b-a86a-2c83fdd7efd2 with identifier: JV77194
2026-03-28 07:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 466b1101-b58d-541b-a86a-2c83fdd7efd2 with identifier: JV77194
2026-03-28 07:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 466b1101-b58d-541b-a86a-2c83fdd7efd2 with identifier: JV77194 to the API
2026-03-28 07:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-28T16:55:26Z',
'fuel_type': 'diesel',
'id': '466b1101-b58d-541b-a86a-2c83fdd7efd2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV77194',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 184714,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-02',
'seller_name': None,
'title': 'BMW 5er 530d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2013}
2026-03-28 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV77194%27 HTTP/1.1" 200 None
2026-03-28 07:38:31 [auto1.de] INFO: Saving data for JV77194: {'auction_closing_time': 1774716926.0, 'created_time': 1773429144.839416, 'last_price_update_time': 1774683511.334078}
2026-03-28 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV77194') HTTP/1.1" 204 0
2026-03-28 07:38:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:38:31 [auto1.de] INFO: Found listing with ID: XD50788
2026-03-28 07:38:31 [auto1.de] INFO: Found listing with ID: VL75204
2026-03-28 07:38:31 [auto1.de] INFO: Found listing with ID: ED89448
2026-03-28 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED89448%27 HTTP/1.1" 200 None
2026-03-28 07:38:31 [auto1.de] INFO: Scrape type for ED89448: 0
2026-03-28 07:38:31 [auto1.de] INFO: Found listing with ID: RL23601
2026-03-28 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL23601%27 HTTP/1.1" 200 None
2026-03-28 07:38:31 [auto1.de] INFO: Scrape type for RL23601: 0
2026-03-28 07:38:31 [auto1.de] INFO: Found listing with ID: EB22696
2026-03-28 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB22696%27 HTTP/1.1" 200 None
2026-03-28 07:38:31 [auto1.de] INFO: Scrape type for EB22696: 0
2026-03-28 07:38:31 [auto1.de] INFO: Found listing with ID: BY18801
2026-03-28 07:38:31 [auto1.de] INFO: Found listing with ID: CC51739
2026-03-28 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC51739%27 HTTP/1.1" 200 None
2026-03-28 07:38:31 [auto1.de] INFO: Scrape type for CC51739: 2
2026-03-28 07:38:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf6eacc0-72dc-5f20-b01c-c81983c6f36c with identifier: CC51739
2026-03-28 07:38:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf6eacc0-72dc-5f20-b01c-c81983c6f36c with scrape type 2
2026-03-28 07:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf6eacc0-72dc-5f20-b01c-c81983c6f36c with scrape type 2
2026-03-28 07:38:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf6eacc0-72dc-5f20-b01c-c81983c6f36c, identifier: CC51739
2026-03-28 07:38:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf6eacc0-72dc-5f20-b01c-c81983c6f36c with identifier: CC51739
2026-03-28 07:38:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf6eacc0-72dc-5f20-b01c-c81983c6f36c with identifier: CC51739
2026-03-28 07:38:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf6eacc0-72dc-5f20-b01c-c81983c6f36c with identifier: CC51739 to the API
2026-03-28 07:38:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:37:14Z',
'fuel_type': 'diesel',
'id': 'cf6eacc0-72dc-5f20-b01c-c81983c6f36c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC51739',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 111718,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-28',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC Avantgarde',
'transmission': 'automatic',
'trim': 'T BlueTEC Avantgarde',
'year': 2018}
2026-03-28 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC51739%27 HTTP/1.1" 200 None
2026-03-28 07:38:32 [auto1.de] INFO: Saving data for CC51739: {'auction_closing_time': 1774715834.0, 'created_time': 1774464673.57373, 'last_price_update_time': 1774683512.000651}
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC51739') HTTP/1.1" 204 0
2026-03-28 07:38:32 [auto1.de] INFO: Found listing with ID: ZL98150
2026-03-28 07:38:32 [auto1.de] INFO: Found listing with ID: PL06364
2026-03-28 07:38:32 [auto1.de] INFO: Found listing with ID: EG86268
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG86268%27 HTTP/1.1" 200 None
2026-03-28 07:38:32 [auto1.de] INFO: Scrape type for EG86268: 2
2026-03-28 07:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 710cecaf-16e3-5384-ab5b-a1fae0060639 with identifier: EG86268
2026-03-28 07:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 710cecaf-16e3-5384-ab5b-a1fae0060639 with scrape type 2
2026-03-28 07:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 710cecaf-16e3-5384-ab5b-a1fae0060639 with scrape type 2
2026-03-28 07:38:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 710cecaf-16e3-5384-ab5b-a1fae0060639, identifier: EG86268
2026-03-28 07:38:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 710cecaf-16e3-5384-ab5b-a1fae0060639 with identifier: EG86268
2026-03-28 07:38:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 710cecaf-16e3-5384-ab5b-a1fae0060639 with identifier: EG86268
2026-03-28 07:38:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 710cecaf-16e3-5384-ab5b-a1fae0060639 with identifier: EG86268 to the API
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:26:02Z',
'fuel_type': 'petrol',
'id': '710cecaf-16e3-5384-ab5b-a1fae0060639',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG86268',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 253543,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-20',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Team',
'transmission': 'manual',
'trim': 'Team',
'year': 2010}
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG86268%27 HTTP/1.1" 200 None
2026-03-28 07:38:32 [auto1.de] INFO: Saving data for EG86268: {'auction_closing_time': 1774715162.0, 'created_time': 1774468138.04914, 'last_price_update_time': 1774683512.513959}
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG86268') HTTP/1.1" 204 0
2026-03-28 07:38:32 [auto1.de] INFO: Found listing with ID: NF90581
2026-03-28 07:38:32 [auto1.de] INFO: Found listing with ID: VZ02719
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ02719%27 HTTP/1.1" 200 None
2026-03-28 07:38:32 [auto1.de] INFO: Scrape type for VZ02719: 0
2026-03-28 07:38:32 [auto1.de] INFO: Found listing with ID: TU73668
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU73668%27 HTTP/1.1" 200 None
2026-03-28 07:38:32 [auto1.de] INFO: Scrape type for TU73668: 0
2026-03-28 07:38:32 [auto1.de] INFO: Found listing with ID: XZ84287
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ84287%27 HTTP/1.1" 200 None
2026-03-28 07:38:32 [auto1.de] INFO: Scrape type for XZ84287: 0
2026-03-28 07:38:32 [auto1.de] INFO: Found listing with ID: PG96137
2026-03-28 07:38:32 [auto1.de] INFO: Found listing with ID: WV38848
2026-03-28 07:38:32 [auto1.de] INFO: Found listing with ID: GZ66698
2026-03-28 07:38:32 [auto1.de] INFO: Found listing with ID: DK78572
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK78572%27 HTTP/1.1" 200 None
2026-03-28 07:38:32 [auto1.de] INFO: Scrape type for DK78572: 0
2026-03-28 07:38:32 [auto1.de] INFO: Found listing with ID: GX28379
2026-03-28 07:38:32 [auto1.de] INFO: Found listing with ID: PE88762
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE88762%27 HTTP/1.1" 200 None
2026-03-28 07:38:32 [auto1.de] INFO: Scrape type for PE88762: 0
2026-03-28 07:38:32 [auto1.de] INFO: Found listing with ID: YN38539
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN38539%27 HTTP/1.1" 200 None
2026-03-28 07:38:32 [auto1.de] INFO: Scrape type for YN38539: 0
2026-03-28 07:38:32 [auto1.de] INFO: Found listing with ID: TW63650
2026-03-28 07:38:32 [auto1.de] INFO: Found listing with ID: DX51383
2026-03-28 07:38:32 [auto1.de] INFO: Found listing with ID: AU05759
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU05759%27 HTTP/1.1" 200 None
2026-03-28 07:38:32 [auto1.de] INFO: Scrape type for AU05759: 2
2026-03-28 07:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9528a698-41ab-50b3-b99d-9e2ca936d8ce with identifier: AU05759
2026-03-28 07:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9528a698-41ab-50b3-b99d-9e2ca936d8ce with scrape type 2
2026-03-28 07:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9528a698-41ab-50b3-b99d-9e2ca936d8ce with scrape type 2
2026-03-28 07:38:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9528a698-41ab-50b3-b99d-9e2ca936d8ce, identifier: AU05759
2026-03-28 07:38:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9528a698-41ab-50b3-b99d-9e2ca936d8ce with identifier: AU05759
2026-03-28 07:38:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9528a698-41ab-50b3-b99d-9e2ca936d8ce with identifier: AU05759
2026-03-28 07:38:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9528a698-41ab-50b3-b99d-9e2ca936d8ce with identifier: AU05759 to the API
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 182,
'expiration_date': '2026-03-28T16:20:24Z',
'fuel_type': 'petrol',
'id': '9528a698-41ab-50b3-b99d-9e2ca936d8ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU05759',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 197921,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-16',
'seller_name': None,
'title': 'Ford Fiesta 1.6 EcoBoost ST',
'transmission': 'manual',
'trim': 'ST',
'year': 2015}
2026-03-28 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU05759%27 HTTP/1.1" 200 None
2026-03-28 07:38:33 [auto1.de] INFO: Saving data for AU05759: {'auction_closing_time': 1774714824.0, 'created_time': 1774464769.036938, 'last_price_update_time': 1774683513.095507}
2026-03-28 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU05759') HTTP/1.1" 204 0
2026-03-28 07:38:33 [auto1.de] INFO: Found listing with ID: HM98480
2026-03-28 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM98480%27 HTTP/1.1" 200 None
2026-03-28 07:38:33 [auto1.de] INFO: Scrape type for HM98480: 0
2026-03-28 07:38:33 [auto1.de] INFO: Found listing with ID: UP04235
2026-03-28 07:38:33 [auto1.de] INFO: Found listing with ID: BN05561
2026-03-28 07:38:33 [auto1.de] INFO: Found listing with ID: BA46324
2026-03-28 07:38:33 [auto1.de] INFO: Found listing with ID: KS48100
2026-03-28 07:38:33 [auto1.de] INFO: Found listing with ID: EP52094
2026-03-28 07:38:33 [auto1.de] INFO: Found listing with ID: SR37454
2026-03-28 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR37454%27 HTTP/1.1" 200 None
2026-03-28 07:38:33 [auto1.de] INFO: Scrape type for SR37454: 0
2026-03-28 07:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:38:34 [auto1.de] INFO: Channel: 24h | Page: 101 | totalHits: 9258 | hits on page: 40
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: GC30737
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC30737%27 HTTP/1.1" 200 None
2026-03-28 07:38:34 [auto1.de] INFO: Scrape type for GC30737: 0
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: YW76305
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: XA77724
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: WF16279
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF16279%27 HTTP/1.1" 200 None
2026-03-28 07:38:34 [auto1.de] INFO: Scrape type for WF16279: 0
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: PW08848
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW08848%27 HTTP/1.1" 200 None
2026-03-28 07:38:34 [auto1.de] INFO: Scrape type for PW08848: 0
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: FR35172
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: FT74133
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT74133%27 HTTP/1.1" 200 None
2026-03-28 07:38:34 [auto1.de] INFO: Scrape type for FT74133: 0
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: UB38135
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: PV29285
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV29285%27 HTTP/1.1" 200 None
2026-03-28 07:38:34 [auto1.de] INFO: Scrape type for PV29285: 0
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: XZ91818
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ91818%27 HTTP/1.1" 200 None
2026-03-28 07:38:34 [auto1.de] INFO: Scrape type for XZ91818: 0
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: EV41055
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV41055%27 HTTP/1.1" 200 None
2026-03-28 07:38:34 [auto1.de] INFO: Scrape type for EV41055: 0
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: FY22177
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY22177%27 HTTP/1.1" 200 None
2026-03-28 07:38:34 [auto1.de] INFO: Scrape type for FY22177: 0
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: ME37510
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME37510%27 HTTP/1.1" 200 None
2026-03-28 07:38:34 [auto1.de] INFO: Scrape type for ME37510: 0
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: JC38309
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC38309%27 HTTP/1.1" 200 None
2026-03-28 07:38:34 [auto1.de] INFO: Scrape type for JC38309: 0
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: WS06283
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS06283%27 HTTP/1.1" 200 None
2026-03-28 07:38:34 [auto1.de] INFO: Scrape type for WS06283: 0
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: WL10604
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL10604%27 HTTP/1.1" 200 None
2026-03-28 07:38:34 [auto1.de] INFO: Scrape type for WL10604: 0
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: BF71090
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: WX30438
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: GU34646
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: AJ43779
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: BJ98180
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ98180%27 HTTP/1.1" 200 None
2026-03-28 07:38:34 [auto1.de] INFO: Scrape type for BJ98180: 0
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: VE89968
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: GR33012
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: CE62650
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: LN30435
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: HE47974
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE47974%27 HTTP/1.1" 200 None
2026-03-28 07:38:34 [auto1.de] INFO: Scrape type for HE47974: 0
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: KF09771
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF09771%27 HTTP/1.1" 200 None
2026-03-28 07:38:34 [auto1.de] INFO: Scrape type for KF09771: 0
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: PT72928
2026-03-28 07:38:34 [auto1.de] INFO: Found listing with ID: KR79365
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR79365%27 HTTP/1.1" 200 None
2026-03-28 07:38:34 [auto1.de] INFO: Scrape type for KR79365: 2
2026-03-28 07:38:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c8faeac-9b8f-5a2b-9ab3-55880f29670c with identifier: KR79365
2026-03-28 07:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c8faeac-9b8f-5a2b-9ab3-55880f29670c with scrape type 2
2026-03-28 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c8faeac-9b8f-5a2b-9ab3-55880f29670c with scrape type 2
2026-03-28 07:38:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c8faeac-9b8f-5a2b-9ab3-55880f29670c, identifier: KR79365
2026-03-28 07:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c8faeac-9b8f-5a2b-9ab3-55880f29670c with identifier: KR79365
2026-03-28 07:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c8faeac-9b8f-5a2b-9ab3-55880f29670c with identifier: KR79365
2026-03-28 07:38:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c8faeac-9b8f-5a2b-9ab3-55880f29670c with identifier: KR79365 to the API
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:08:43Z',
'fuel_type': 'diesel',
'id': '6c8faeac-9b8f-5a2b-9ab3-55880f29670c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR79365',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Caravelle',
'odometer': 249801,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-09',
'seller_name': None,
'title': 'Volkswagen T5 Caravelle 1.9 TDI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2009}
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR79365%27 HTTP/1.1" 200 None
2026-03-28 07:38:34 [auto1.de] INFO: Saving data for KR79365: {'auction_closing_time': 1774714123.0, 'created_time': 1774467935.112184, 'last_price_update_time': 1774683514.977207}
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR79365') HTTP/1.1" 204 0
2026-03-28 07:38:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:38:35 [auto1.de] INFO: Found listing with ID: FB02841
2026-03-28 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB02841%27 HTTP/1.1" 200 None
2026-03-28 07:38:35 [auto1.de] INFO: Scrape type for FB02841: 0
2026-03-28 07:38:35 [auto1.de] INFO: Found listing with ID: FC01823
2026-03-28 07:38:35 [auto1.de] INFO: Found listing with ID: AS86297
2026-03-28 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS86297%27 HTTP/1.1" 200 None
2026-03-28 07:38:35 [auto1.de] INFO: Scrape type for AS86297: 0
2026-03-28 07:38:35 [auto1.de] INFO: Found listing with ID: ZS85810
2026-03-28 07:38:35 [auto1.de] INFO: Found listing with ID: KV45181
2026-03-28 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV45181%27 HTTP/1.1" 200 None
2026-03-28 07:38:35 [auto1.de] INFO: Scrape type for KV45181: 0
2026-03-28 07:38:35 [auto1.de] INFO: Found listing with ID: ZW22458
2026-03-28 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW22458%27 HTTP/1.1" 200 None
2026-03-28 07:38:35 [auto1.de] INFO: Scrape type for ZW22458: 0
2026-03-28 07:38:35 [auto1.de] INFO: Found listing with ID: YG55269
2026-03-28 07:38:35 [auto1.de] INFO: Found listing with ID: JV66840
2026-03-28 07:38:35 [auto1.de] INFO: Found listing with ID: RH52660
2026-03-28 07:38:35 [auto1.de] INFO: Found listing with ID: XN01413
2026-03-28 07:38:35 [auto1.de] INFO: Found listing with ID: SL85430
2026-03-28 07:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:38:36 [auto1.de] INFO: Channel: 24h | Page: 102 | totalHits: 9259 | hits on page: 40
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: SL85430
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: AJ18698
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ18698%27 HTTP/1.1" 200 None
2026-03-28 07:38:36 [auto1.de] INFO: Scrape type for AJ18698: 0
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: AA89468
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA89468%27 HTTP/1.1" 200 None
2026-03-28 07:38:36 [auto1.de] INFO: Scrape type for AA89468: 0
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: BH73994
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: HH54065
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: NT54414
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: CK74950
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: NH53597
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: HP00850
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP00850%27 HTTP/1.1" 200 None
2026-03-28 07:38:36 [auto1.de] INFO: Scrape type for HP00850: 0
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: AB52853
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: KU59477
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: XB46016
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB46016%27 HTTP/1.1" 200 None
2026-03-28 07:38:36 [auto1.de] INFO: Scrape type for XB46016: 0
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: RW72684
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: PN56757
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: YT16808
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT16808%27 HTTP/1.1" 200 None
2026-03-28 07:38:36 [auto1.de] INFO: Scrape type for YT16808: 0
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: RW26653
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: DM43280
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM43280%27 HTTP/1.1" 200 None
2026-03-28 07:38:36 [auto1.de] INFO: Scrape type for DM43280: 0
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: XM85964
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM85964%27 HTTP/1.1" 200 None
2026-03-28 07:38:36 [auto1.de] INFO: Scrape type for XM85964: 0
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: GA42145
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA42145%27 HTTP/1.1" 200 None
2026-03-28 07:38:36 [auto1.de] INFO: Scrape type for GA42145: 0
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: MU10500
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: CY90259
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY90259%27 HTTP/1.1" 200 None
2026-03-28 07:38:36 [auto1.de] INFO: Scrape type for CY90259: 0
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: SG08680
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: EZ01332
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ01332%27 HTTP/1.1" 200 None
2026-03-28 07:38:36 [auto1.de] INFO: Scrape type for EZ01332: 0
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: MJ74950
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ74950%27 HTTP/1.1" 200 None
2026-03-28 07:38:36 [auto1.de] INFO: Scrape type for MJ74950: 0
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: LM68672
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM68672%27 HTTP/1.1" 200 None
2026-03-28 07:38:36 [auto1.de] INFO: Scrape type for LM68672: 0
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: ZR25455
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR25455%27 HTTP/1.1" 200 None
2026-03-28 07:38:36 [auto1.de] INFO: Scrape type for ZR25455: 0
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: ZS20777
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS20777%27 HTTP/1.1" 200 None
2026-03-28 07:38:36 [auto1.de] INFO: Scrape type for ZS20777: 0
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: VF40931
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF40931%27 HTTP/1.1" 200 None
2026-03-28 07:38:36 [auto1.de] INFO: Scrape type for VF40931: 0
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: ZM93791
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: NY36854
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY36854%27 HTTP/1.1" 200 None
2026-03-28 07:38:36 [auto1.de] INFO: Scrape type for NY36854: 0
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: KG29776
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG29776%27 HTTP/1.1" 200 None
2026-03-28 07:38:36 [auto1.de] INFO: Scrape type for KG29776: 0
2026-03-28 07:38:36 [auto1.de] INFO: Found listing with ID: DC48587
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC48587%27 HTTP/1.1" 200 None
2026-03-28 07:38:36 [auto1.de] INFO: Scrape type for DC48587: 2
2026-03-28 07:38:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a195b53f-3b75-53fc-b57c-8b10db046496 with identifier: DC48587
2026-03-28 07:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a195b53f-3b75-53fc-b57c-8b10db046496 with scrape type 2
2026-03-28 07:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a195b53f-3b75-53fc-b57c-8b10db046496 with scrape type 2
2026-03-28 07:38:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a195b53f-3b75-53fc-b57c-8b10db046496, identifier: DC48587
2026-03-28 07:38:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a195b53f-3b75-53fc-b57c-8b10db046496 with identifier: DC48587
2026-03-28 07:38:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a195b53f-3b75-53fc-b57c-8b10db046496 with identifier: DC48587
2026-03-28 07:38:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a195b53f-3b75-53fc-b57c-8b10db046496 with identifier: DC48587 to the API
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:53:56Z',
'fuel_type': 'petrol',
'id': 'a195b53f-3b75-53fc-b57c-8b10db046496',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC48587',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Outlander',
'odometer': 165433,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-10-01',
'seller_name': None,
'title': 'Mitsubishi Outlander 2.0 Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2003}
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC48587%27 HTTP/1.1" 200 None
2026-03-28 07:38:36 [auto1.de] INFO: Saving data for DC48587: {'auction_closing_time': 1774716836.0, 'created_time': 1774468205.60562, 'last_price_update_time': 1774683516.992623}
2026-03-28 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC48587') HTTP/1.1" 204 0
2026-03-28 07:38:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:38:37 [auto1.de] INFO: Found listing with ID: KV44298
2026-03-28 07:38:37 [auto1.de] INFO: Found listing with ID: XM74841
2026-03-28 07:38:37 [auto1.de] INFO: Found listing with ID: JC18235
2026-03-28 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC18235%27 HTTP/1.1" 200 None
2026-03-28 07:38:37 [auto1.de] INFO: Scrape type for JC18235: 0
2026-03-28 07:38:37 [auto1.de] INFO: Found listing with ID: GF12602
2026-03-28 07:38:37 [auto1.de] INFO: Found listing with ID: GH70383
2026-03-28 07:38:37 [auto1.de] INFO: Found listing with ID: CX46071
2026-03-28 07:38:37 [auto1.de] INFO: Found listing with ID: DE53161
2026-03-28 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE53161%27 HTTP/1.1" 200 None
2026-03-28 07:38:37 [auto1.de] INFO: Scrape type for DE53161: 2
2026-03-28 07:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbaba9d1-5f47-533e-8593-10de175afd25 with identifier: DE53161
2026-03-28 07:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbaba9d1-5f47-533e-8593-10de175afd25 with scrape type 2
2026-03-28 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbaba9d1-5f47-533e-8593-10de175afd25 with scrape type 2
2026-03-28 07:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbaba9d1-5f47-533e-8593-10de175afd25, identifier: DE53161
2026-03-28 07:38:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbaba9d1-5f47-533e-8593-10de175afd25 with identifier: DE53161
2026-03-28 07:38:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbaba9d1-5f47-533e-8593-10de175afd25 with identifier: DE53161
2026-03-28 07:38:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbaba9d1-5f47-533e-8593-10de175afd25 with identifier: DE53161 to the API
2026-03-28 07:38:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:06:03Z',
'fuel_type': 'petrol',
'id': 'cbaba9d1-5f47-533e-8593-10de175afd25',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE53161',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 112064,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-08',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 200 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2016}
2026-03-28 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE53161%27 HTTP/1.1" 200 None
2026-03-28 07:38:37 [auto1.de] INFO: Saving data for DE53161: {'auction_closing_time': 1774713963.0, 'created_time': 1774465941.291838, 'last_price_update_time': 1774683517.533691}
2026-03-28 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE53161') HTTP/1.1" 204 0
2026-03-28 07:38:37 [auto1.de] INFO: Found listing with ID: KE44581
2026-03-28 07:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:38:38 [auto1.de] INFO: Channel: 24h | Page: 103 | totalHits: 9260 | hits on page: 40
2026-03-28 07:38:38 [auto1.de] INFO: Found listing with ID: KE44581
2026-03-28 07:38:38 [auto1.de] INFO: Found listing with ID: LE29079
2026-03-28 07:38:38 [auto1.de] INFO: Found listing with ID: NJ97251
2026-03-28 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ97251%27 HTTP/1.1" 200 None
2026-03-28 07:38:38 [auto1.de] INFO: Scrape type for NJ97251: 0
2026-03-28 07:38:38 [auto1.de] INFO: Found listing with ID: GB19740
2026-03-28 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB19740%27 HTTP/1.1" 200 None
2026-03-28 07:38:38 [auto1.de] INFO: Scrape type for GB19740: 2
2026-03-28 07:38:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfe11a72-d64e-570f-ae8a-e42936684212 with identifier: GB19740
2026-03-28 07:38:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfe11a72-d64e-570f-ae8a-e42936684212 with scrape type 2
2026-03-28 07:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfe11a72-d64e-570f-ae8a-e42936684212 with scrape type 2
2026-03-28 07:38:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dfe11a72-d64e-570f-ae8a-e42936684212, identifier: GB19740
2026-03-28 07:38:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dfe11a72-d64e-570f-ae8a-e42936684212 with identifier: GB19740
2026-03-28 07:38:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dfe11a72-d64e-570f-ae8a-e42936684212 with identifier: GB19740
2026-03-28 07:38:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dfe11a72-d64e-570f-ae8a-e42936684212 with identifier: GB19740 to the API
2026-03-28 07:38:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:59:28Z',
'fuel_type': 'petrol',
'id': 'dfe11a72-d64e-570f-ae8a-e42936684212',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB19740',
'listing': 'auction',
'make': 'Audi',
'model': 'Q2',
'odometer': 81612,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-23',
'seller_name': None,
'title': 'Audi Q2 35 TFSI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2020}
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB19740%27 HTTP/1.1" 200 None
2026-03-28 07:38:39 [auto1.de] INFO: Saving data for GB19740: {'auction_closing_time': 1774717168.0, 'created_time': 1773859470.544772, 'last_price_update_time': 1774683519.158122}
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB19740') HTTP/1.1" 204 0
2026-03-28 07:38:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: ZM05379
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM05379%27 HTTP/1.1" 200 None
2026-03-28 07:38:39 [auto1.de] INFO: Scrape type for ZM05379: 0
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: WM92411
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: NT04254
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT04254%27 HTTP/1.1" 200 None
2026-03-28 07:38:39 [auto1.de] INFO: Scrape type for NT04254: 0
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: PE04478
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: UD59606
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: EL74738
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL74738%27 HTTP/1.1" 200 None
2026-03-28 07:38:39 [auto1.de] INFO: Scrape type for EL74738: 0
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: UH34905
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH34905%27 HTTP/1.1" 200 None
2026-03-28 07:38:39 [auto1.de] INFO: Scrape type for UH34905: 0
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: LS45558
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: SJ72681
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: GW29634
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW29634%27 HTTP/1.1" 200 None
2026-03-28 07:38:39 [auto1.de] INFO: Scrape type for GW29634: 0
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: MT90802
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT90802%27 HTTP/1.1" 200 None
2026-03-28 07:38:39 [auto1.de] INFO: Scrape type for MT90802: 0
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: DW74206
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: SG73532
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG73532%27 HTTP/1.1" 200 None
2026-03-28 07:38:39 [auto1.de] INFO: Scrape type for SG73532: 0
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: PP35153
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: GT24864
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: WY46685
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY46685%27 HTTP/1.1" 200 None
2026-03-28 07:38:39 [auto1.de] INFO: Scrape type for WY46685: 0
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: FW07623
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: EY26571
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: SZ79532
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: CA14151
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA14151%27 HTTP/1.1" 200 None
2026-03-28 07:38:39 [auto1.de] INFO: Scrape type for CA14151: 0
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: RT17633
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: XS36937
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: DH78360
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: BM31151
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: KX36775
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: JM32956
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: RR06501
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR06501%27 HTTP/1.1" 200 None
2026-03-28 07:38:39 [auto1.de] INFO: Scrape type for RR06501: 0
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: GJ44071
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: RP55300
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: SN98432
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN98432%27 HTTP/1.1" 200 None
2026-03-28 07:38:39 [auto1.de] INFO: Scrape type for SN98432: 0
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: YR53250
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR53250%27 HTTP/1.1" 200 None
2026-03-28 07:38:39 [auto1.de] INFO: Scrape type for YR53250: 0
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: JM90464
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM90464%27 HTTP/1.1" 200 None
2026-03-28 07:38:39 [auto1.de] INFO: Scrape type for JM90464: 0
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: AJ98197
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: DE62797
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: VH36335
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH36335%27 HTTP/1.1" 200 None
2026-03-28 07:38:39 [auto1.de] INFO: Scrape type for VH36335: 0
2026-03-28 07:38:39 [auto1.de] INFO: Found listing with ID: MA47632
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA47632%27 HTTP/1.1" 200 None
2026-03-28 07:38:39 [auto1.de] INFO: Scrape type for MA47632: 0
2026-03-28 07:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:38:41 [auto1.de] INFO: Channel: 24h | Page: 104 | totalHits: 9260 | hits on page: 40
2026-03-28 07:38:41 [auto1.de] INFO: Found listing with ID: YU90808
2026-03-28 07:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU90808%27 HTTP/1.1" 200 None
2026-03-28 07:38:41 [auto1.de] INFO: Scrape type for YU90808: 2
2026-03-28 07:38:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9310a26b-2353-58bc-83e3-7dfad16ac5de with identifier: YU90808
2026-03-28 07:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9310a26b-2353-58bc-83e3-7dfad16ac5de with scrape type 2
2026-03-28 07:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9310a26b-2353-58bc-83e3-7dfad16ac5de with scrape type 2
2026-03-28 07:38:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9310a26b-2353-58bc-83e3-7dfad16ac5de, identifier: YU90808
2026-03-28 07:38:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9310a26b-2353-58bc-83e3-7dfad16ac5de with identifier: YU90808
2026-03-28 07:38:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9310a26b-2353-58bc-83e3-7dfad16ac5de with identifier: YU90808
2026-03-28 07:38:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9310a26b-2353-58bc-83e3-7dfad16ac5de with identifier: YU90808 to the API
2026-03-28 07:38:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 262,
'expiration_date': '2026-03-28T16:32:50Z',
'fuel_type': 'diesel',
'id': '9310a26b-2353-58bc-83e3-7dfad16ac5de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU90808',
'listing': 'auction',
'make': 'Porsche',
'model': 'Cayenne',
'odometer': 101807,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-02',
'seller_name': None,
'title': 'Porsche Cayenne Diesel',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-28 07:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU90808%27 HTTP/1.1" 200 None
2026-03-28 07:38:41 [auto1.de] INFO: Saving data for YU90808: {'auction_closing_time': 1774715570.0, 'created_time': 1774465024.380615, 'last_price_update_time': 1774683521.588158}
2026-03-28 07:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU90808') HTTP/1.1" 204 0
2026-03-28 07:38:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:38:41 [auto1.de] INFO: Found listing with ID: RS09713
2026-03-28 07:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS09713%27 HTTP/1.1" 200 None
2026-03-28 07:38:41 [auto1.de] INFO: Scrape type for RS09713: 0
2026-03-28 07:38:41 [auto1.de] INFO: Found listing with ID: NE09834
2026-03-28 07:38:41 [auto1.de] INFO: Found listing with ID: XU78449
2026-03-28 07:38:41 [auto1.de] INFO: Found listing with ID: GR47170
2026-03-28 07:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR47170%27 HTTP/1.1" 200 None
2026-03-28 07:38:41 [auto1.de] INFO: Scrape type for GR47170: 0
2026-03-28 07:38:41 [auto1.de] INFO: Found listing with ID: WG42712
2026-03-28 07:38:41 [auto1.de] INFO: Found listing with ID: XF30370
2026-03-28 07:38:41 [auto1.de] INFO: Found listing with ID: FD43857
2026-03-28 07:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD43857%27 HTTP/1.1" 200 None
2026-03-28 07:38:41 [auto1.de] INFO: Scrape type for FD43857: 0
2026-03-28 07:38:41 [auto1.de] INFO: Found listing with ID: UR23354
2026-03-28 07:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR23354%27 HTTP/1.1" 200 None
2026-03-28 07:38:41 [auto1.de] INFO: Scrape type for UR23354: 2
2026-03-28 07:38:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb51197d-7a18-593c-98a2-1b1302b33506 with identifier: UR23354
2026-03-28 07:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb51197d-7a18-593c-98a2-1b1302b33506 with scrape type 2
2026-03-28 07:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb51197d-7a18-593c-98a2-1b1302b33506 with scrape type 2
2026-03-28 07:38:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb51197d-7a18-593c-98a2-1b1302b33506, identifier: UR23354
2026-03-28 07:38:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb51197d-7a18-593c-98a2-1b1302b33506 with identifier: UR23354
2026-03-28 07:38:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb51197d-7a18-593c-98a2-1b1302b33506 with identifier: UR23354
2026-03-28 07:38:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb51197d-7a18-593c-98a2-1b1302b33506 with identifier: UR23354 to the API
2026-03-28 07:38:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:51:10Z',
'fuel_type': 'petrol',
'id': 'fb51197d-7a18-593c-98a2-1b1302b33506',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR23354',
'listing': 'auction',
'make': 'Dacia',
'model': 'Dokker Express',
'odometer': 58872,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-18',
'seller_name': None,
'title': 'Dacia Dokker Express 1.6 SCe Essentiel',
'transmission': 'manual',
'trim': 'Essentiel',
'year': 2017}
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR23354%27 HTTP/1.1" 200 None
2026-03-28 07:38:42 [auto1.de] INFO: Saving data for UR23354: {'auction_closing_time': 1774716670.0, 'created_time': 1774466155.399885, 'last_price_update_time': 1774683522.177041}
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR23354') HTTP/1.1" 204 0
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: UX96397
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: MD28081
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: DF94308
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: HH37576
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: NX83619
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX83619%27 HTTP/1.1" 200 None
2026-03-28 07:38:42 [auto1.de] INFO: Scrape type for NX83619: 0
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: WE84338
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE84338%27 HTTP/1.1" 200 None
2026-03-28 07:38:42 [auto1.de] INFO: Scrape type for WE84338: 2
2026-03-28 07:38:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 000735e7-55de-5cda-bb0a-e1814f12476a with identifier: WE84338
2026-03-28 07:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 000735e7-55de-5cda-bb0a-e1814f12476a with scrape type 2
2026-03-28 07:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 000735e7-55de-5cda-bb0a-e1814f12476a with scrape type 2
2026-03-28 07:38:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 000735e7-55de-5cda-bb0a-e1814f12476a, identifier: WE84338
2026-03-28 07:38:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 000735e7-55de-5cda-bb0a-e1814f12476a with identifier: WE84338
2026-03-28 07:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 000735e7-55de-5cda-bb0a-e1814f12476a with identifier: WE84338
2026-03-28 07:38:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 000735e7-55de-5cda-bb0a-e1814f12476a with identifier: WE84338 to the API
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:28:56Z',
'fuel_type': 'diesel',
'id': '000735e7-55de-5cda-bb0a-e1814f12476a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE84338',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 207667,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-26',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 1.6 CDTI DPF Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2014}
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE84338%27 HTTP/1.1" 200 None
2026-03-28 07:38:42 [auto1.de] INFO: Saving data for WE84338: {'auction_closing_time': 1774715336.0, 'created_time': 1774467947.340823, 'last_price_update_time': 1774683522.614243}
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE84338') HTTP/1.1" 204 0
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: FA30463
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: SM51050
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM51050%27 HTTP/1.1" 200 None
2026-03-28 07:38:42 [auto1.de] INFO: Scrape type for SM51050: 0
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: WZ70999
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ70999%27 HTTP/1.1" 200 None
2026-03-28 07:38:42 [auto1.de] INFO: Scrape type for WZ70999: 0
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: KX20208
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: CE75609
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: BS12616
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: DM53620
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM53620%27 HTTP/1.1" 200 None
2026-03-28 07:38:42 [auto1.de] INFO: Scrape type for DM53620: 0
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: HY95420
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: WT92496
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: SK78109
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK78109%27 HTTP/1.1" 200 None
2026-03-28 07:38:42 [auto1.de] INFO: Scrape type for SK78109: 0
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: PJ80384
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ80384%27 HTTP/1.1" 200 None
2026-03-28 07:38:42 [auto1.de] INFO: Scrape type for PJ80384: 0
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: BR45511
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR45511%27 HTTP/1.1" 200 None
2026-03-28 07:38:42 [auto1.de] INFO: Scrape type for BR45511: 0
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: GU64592
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU64592%27 HTTP/1.1" 200 None
2026-03-28 07:38:42 [auto1.de] INFO: Scrape type for GU64592: 0
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: TS77331
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS77331%27 HTTP/1.1" 200 None
2026-03-28 07:38:42 [auto1.de] INFO: Scrape type for TS77331: 0
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: RK36338
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: SE81381
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE81381%27 HTTP/1.1" 200 None
2026-03-28 07:38:42 [auto1.de] INFO: Scrape type for SE81381: 0
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: TW05114
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW05114%27 HTTP/1.1" 200 None
2026-03-28 07:38:42 [auto1.de] INFO: Scrape type for TW05114: 0
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: LN34178
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: BH71289
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH71289%27 HTTP/1.1" 200 None
2026-03-28 07:38:42 [auto1.de] INFO: Scrape type for BH71289: 0
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: VP41401
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP41401%27 HTTP/1.1" 200 None
2026-03-28 07:38:42 [auto1.de] INFO: Scrape type for VP41401: 0
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: RB35490
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB35490%27 HTTP/1.1" 200 None
2026-03-28 07:38:42 [auto1.de] INFO: Scrape type for RB35490: 0
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: MY93423
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: WG27498
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: AN68791
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN68791%27 HTTP/1.1" 200 None
2026-03-28 07:38:42 [auto1.de] INFO: Scrape type for AN68791: 0
2026-03-28 07:38:42 [auto1.de] INFO: Found listing with ID: UA00536
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA00536%27 HTTP/1.1" 200 None
2026-03-28 07:38:42 [auto1.de] INFO: Scrape type for UA00536: 0
2026-03-28 07:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:38:43 [auto1.de] INFO: Channel: 24h | Page: 105 | totalHits: 9259 | hits on page: 40
2026-03-28 07:38:43 [auto1.de] INFO: Found listing with ID: US80699
2026-03-28 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US80699%27 HTTP/1.1" 200 None
2026-03-28 07:38:43 [auto1.de] INFO: Scrape type for US80699: 0
2026-03-28 07:38:43 [auto1.de] INFO: Found listing with ID: JF12446
2026-03-28 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF12446%27 HTTP/1.1" 200 None
2026-03-28 07:38:43 [auto1.de] INFO: Scrape type for JF12446: 0
2026-03-28 07:38:43 [auto1.de] INFO: Found listing with ID: GB62942
2026-03-28 07:38:43 [auto1.de] INFO: Found listing with ID: LL54952
2026-03-28 07:38:43 [auto1.de] INFO: Found listing with ID: DU80644
2026-03-28 07:38:43 [auto1.de] INFO: Found listing with ID: YG98793
2026-03-28 07:38:43 [auto1.de] INFO: Found listing with ID: ZN92027
2026-03-28 07:38:43 [auto1.de] INFO: Found listing with ID: SB14031
2026-03-28 07:38:43 [auto1.de] INFO: Found listing with ID: HG78965
2026-03-28 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG78965%27 HTTP/1.1" 200 None
2026-03-28 07:38:43 [auto1.de] INFO: Scrape type for HG78965: 0
2026-03-28 07:38:43 [auto1.de] INFO: Found listing with ID: UH62107
2026-03-28 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH62107%27 HTTP/1.1" 200 None
2026-03-28 07:38:43 [auto1.de] INFO: Scrape type for UH62107: 2
2026-03-28 07:38:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edae4c65-578c-5f34-ac2d-b3fe845359cb with identifier: UH62107
2026-03-28 07:38:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edae4c65-578c-5f34-ac2d-b3fe845359cb with scrape type 2
2026-03-28 07:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edae4c65-578c-5f34-ac2d-b3fe845359cb with scrape type 2
2026-03-28 07:38:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edae4c65-578c-5f34-ac2d-b3fe845359cb, identifier: UH62107
2026-03-28 07:38:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edae4c65-578c-5f34-ac2d-b3fe845359cb with identifier: UH62107
2026-03-28 07:38:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edae4c65-578c-5f34-ac2d-b3fe845359cb with identifier: UH62107
2026-03-28 07:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edae4c65-578c-5f34-ac2d-b3fe845359cb with identifier: UH62107 to the API
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:30:25Z',
'fuel_type': 'petrol',
'id': 'edae4c65-578c-5f34-ac2d-b3fe845359cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH62107',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 179353,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-12-06',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 Kompressor Avantgarde',
'transmission': 'manual',
'trim': 'Avantgarde',
'year': 2004}
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH62107%27 HTTP/1.1" 200 None
2026-03-28 07:38:44 [auto1.de] INFO: Saving data for UH62107: {'auction_closing_time': 1774715425.0, 'created_time': 1774467926.946535, 'last_price_update_time': 1774683524.282118}
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH62107') HTTP/1.1" 204 0
2026-03-28 07:38:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:38:44 [auto1.de] INFO: Found listing with ID: AT99674
2026-03-28 07:38:44 [auto1.de] INFO: Found listing with ID: EC44311
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC44311%27 HTTP/1.1" 200 None
2026-03-28 07:38:44 [auto1.de] INFO: Scrape type for EC44311: 0
2026-03-28 07:38:44 [auto1.de] INFO: Found listing with ID: DE48609
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE48609%27 HTTP/1.1" 200 None
2026-03-28 07:38:44 [auto1.de] INFO: Scrape type for DE48609: 0
2026-03-28 07:38:44 [auto1.de] INFO: Found listing with ID: WG52283
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG52283%27 HTTP/1.1" 200 None
2026-03-28 07:38:44 [auto1.de] INFO: Scrape type for WG52283: 0
2026-03-28 07:38:44 [auto1.de] INFO: Found listing with ID: UY95441
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY95441%27 HTTP/1.1" 200 None
2026-03-28 07:38:44 [auto1.de] INFO: Scrape type for UY95441: 0
2026-03-28 07:38:44 [auto1.de] INFO: Found listing with ID: MU38011
2026-03-28 07:38:44 [auto1.de] INFO: Found listing with ID: CR61198
2026-03-28 07:38:44 [auto1.de] INFO: Found listing with ID: DZ26668
2026-03-28 07:38:44 [auto1.de] INFO: Found listing with ID: PP69489
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP69489%27 HTTP/1.1" 200 None
2026-03-28 07:38:44 [auto1.de] INFO: Scrape type for PP69489: 2
2026-03-28 07:38:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e29015e8-ae56-585a-8faf-8dc0a19967fc with identifier: PP69489
2026-03-28 07:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e29015e8-ae56-585a-8faf-8dc0a19967fc with scrape type 2
2026-03-28 07:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e29015e8-ae56-585a-8faf-8dc0a19967fc with scrape type 2
2026-03-28 07:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e29015e8-ae56-585a-8faf-8dc0a19967fc, identifier: PP69489
2026-03-28 07:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e29015e8-ae56-585a-8faf-8dc0a19967fc with identifier: PP69489
2026-03-28 07:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e29015e8-ae56-585a-8faf-8dc0a19967fc with identifier: PP69489
2026-03-28 07:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e29015e8-ae56-585a-8faf-8dc0a19967fc with identifier: PP69489 to the API
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:53:24Z',
'fuel_type': 'petrol',
'id': 'e29015e8-ae56-585a-8faf-8dc0a19967fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP69489',
'listing': 'auction',
'make': 'Renault',
'model': 'Grand Modus',
'odometer': 95511,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-21',
'seller_name': None,
'title': 'Renault Grand Modus 1.2 Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2009}
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP69489%27 HTTP/1.1" 200 None
2026-03-28 07:38:44 [auto1.de] INFO: Saving data for PP69489: {'auction_closing_time': 1774716804.0, 'created_time': 1774467721.214183, 'last_price_update_time': 1774683524.873537}
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP69489') HTTP/1.1" 204 0
2026-03-28 07:38:44 [auto1.de] INFO: Found listing with ID: FX85164
2026-03-28 07:38:44 [auto1.de] INFO: Found listing with ID: MD91791
2026-03-28 07:38:44 [auto1.de] INFO: Found listing with ID: WE14198
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE14198%27 HTTP/1.1" 200 None
2026-03-28 07:38:44 [auto1.de] INFO: Scrape type for WE14198: 0
2026-03-28 07:38:44 [auto1.de] INFO: Found listing with ID: BX93358
2026-03-28 07:38:44 [auto1.de] INFO: Found listing with ID: LT46739
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT46739%27 HTTP/1.1" 200 None
2026-03-28 07:38:44 [auto1.de] INFO: Scrape type for LT46739: 0
2026-03-28 07:38:44 [auto1.de] INFO: Found listing with ID: BF99828
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF99828%27 HTTP/1.1" 200 None
2026-03-28 07:38:44 [auto1.de] INFO: Scrape type for BF99828: 0
2026-03-28 07:38:44 [auto1.de] INFO: Found listing with ID: VU57107
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU57107%27 HTTP/1.1" 200 None
2026-03-28 07:38:44 [auto1.de] INFO: Scrape type for VU57107: 0
2026-03-28 07:38:44 [auto1.de] INFO: Found listing with ID: KJ44451
2026-03-28 07:38:44 [auto1.de] INFO: Found listing with ID: KD44846
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD44846%27 HTTP/1.1" 200 None
2026-03-28 07:38:44 [auto1.de] INFO: Scrape type for KD44846: 2
2026-03-28 07:38:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10e5e992-172f-5232-a81c-994c82278abe with identifier: KD44846
2026-03-28 07:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10e5e992-172f-5232-a81c-994c82278abe with scrape type 2
2026-03-28 07:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10e5e992-172f-5232-a81c-994c82278abe with scrape type 2
2026-03-28 07:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10e5e992-172f-5232-a81c-994c82278abe, identifier: KD44846
2026-03-28 07:38:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10e5e992-172f-5232-a81c-994c82278abe with identifier: KD44846
2026-03-28 07:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10e5e992-172f-5232-a81c-994c82278abe with identifier: KD44846
2026-03-28 07:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10e5e992-172f-5232-a81c-994c82278abe with identifier: KD44846 to the API
2026-03-28 07:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:43:32Z',
'fuel_type': 'petrol',
'id': '10e5e992-172f-5232-a81c-994c82278abe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD44846',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 67458,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-26',
'seller_name': None,
'title': 'Ford Kuga 1.5 EcoBoost ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2018}
2026-03-28 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD44846%27 HTTP/1.1" 200 None
2026-03-28 07:38:45 [auto1.de] INFO: Saving data for KD44846: {'auction_closing_time': 1774716212.0, 'created_time': 1774468114.652607, 'last_price_update_time': 1774683525.470956}
2026-03-28 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD44846') HTTP/1.1" 204 0
2026-03-28 07:38:45 [auto1.de] INFO: Found listing with ID: BR96483
2026-03-28 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR96483%27 HTTP/1.1" 200 None
2026-03-28 07:38:45 [auto1.de] INFO: Scrape type for BR96483: 0
2026-03-28 07:38:45 [auto1.de] INFO: Found listing with ID: MU97238
2026-03-28 07:38:45 [auto1.de] INFO: Found listing with ID: KP26466
2026-03-28 07:38:45 [auto1.de] INFO: Found listing with ID: KW72669
2026-03-28 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW72669%27 HTTP/1.1" 200 None
2026-03-28 07:38:45 [auto1.de] INFO: Scrape type for KW72669: 0
2026-03-28 07:38:45 [auto1.de] INFO: Found listing with ID: SD16829
2026-03-28 07:38:45 [auto1.de] INFO: Found listing with ID: XY49734
2026-03-28 07:38:45 [auto1.de] INFO: Found listing with ID: TM93918
2026-03-28 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM93918%27 HTTP/1.1" 200 None
2026-03-28 07:38:45 [auto1.de] INFO: Scrape type for TM93918: 0
2026-03-28 07:38:45 [auto1.de] INFO: Found listing with ID: HG94589
2026-03-28 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG94589%27 HTTP/1.1" 200 None
2026-03-28 07:38:45 [auto1.de] INFO: Scrape type for HG94589: 0
2026-03-28 07:38:45 [auto1.de] INFO: Found listing with ID: FE82761
2026-03-28 07:38:45 [auto1.de] INFO: Found listing with ID: UH39337
2026-03-28 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH39337%27 HTTP/1.1" 200 None
2026-03-28 07:38:45 [auto1.de] INFO: Scrape type for UH39337: 0
2026-03-28 07:38:45 [auto1.de] INFO: Found listing with ID: VF58468
2026-03-28 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF58468%27 HTTP/1.1" 200 None
2026-03-28 07:38:45 [auto1.de] INFO: Scrape type for VF58468: 0
2026-03-28 07:38:45 [auto1.de] INFO: Found listing with ID: GN34545
2026-03-28 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN34545%27 HTTP/1.1" 200 None
2026-03-28 07:38:45 [auto1.de] INFO: Scrape type for GN34545: 2
2026-03-28 07:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b9bf296-dbde-5ea8-9e29-da0ee1cd5942 with identifier: GN34545
2026-03-28 07:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b9bf296-dbde-5ea8-9e29-da0ee1cd5942 with scrape type 2
2026-03-28 07:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b9bf296-dbde-5ea8-9e29-da0ee1cd5942 with scrape type 2
2026-03-28 07:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b9bf296-dbde-5ea8-9e29-da0ee1cd5942, identifier: GN34545
2026-03-28 07:38:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b9bf296-dbde-5ea8-9e29-da0ee1cd5942 with identifier: GN34545
2026-03-28 07:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b9bf296-dbde-5ea8-9e29-da0ee1cd5942 with identifier: GN34545
2026-03-28 07:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b9bf296-dbde-5ea8-9e29-da0ee1cd5942 with identifier: GN34545 to the API
2026-03-28 07:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:16:44Z',
'fuel_type': 'petrol',
'id': '0b9bf296-dbde-5ea8-9e29-da0ee1cd5942',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN34545',
'listing': 'auction',
'make': 'Mazda',
'model': '5',
'odometer': 192235,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-18',
'seller_name': None,
'title': 'Mazda 5 2.0 Sendo',
'transmission': 'manual',
'trim': 'Sendo',
'year': 2014}
2026-03-28 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN34545%27 HTTP/1.1" 200 None
2026-03-28 07:38:46 [auto1.de] INFO: Saving data for GN34545: {'auction_closing_time': 1774714604.0, 'created_time': 1774466253.001757, 'last_price_update_time': 1774683526.122051}
2026-03-28 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN34545') HTTP/1.1" 204 0
2026-03-28 07:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:38:47 [auto1.de] INFO: Channel: 24h | Page: 106 | totalHits: 9259 | hits on page: 40
2026-03-28 07:38:47 [auto1.de] INFO: Found listing with ID: DF56561
2026-03-28 07:38:47 [auto1.de] INFO: Found listing with ID: AX05143
2026-03-28 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX05143%27 HTTP/1.1" 200 None
2026-03-28 07:38:47 [auto1.de] INFO: Scrape type for AX05143: 2
2026-03-28 07:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2a0d621-7c1a-5bf6-a933-1453c9b2b7c7 with identifier: AX05143
2026-03-28 07:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2a0d621-7c1a-5bf6-a933-1453c9b2b7c7 with scrape type 2
2026-03-28 07:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2a0d621-7c1a-5bf6-a933-1453c9b2b7c7 with scrape type 2
2026-03-28 07:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2a0d621-7c1a-5bf6-a933-1453c9b2b7c7, identifier: AX05143
2026-03-28 07:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2a0d621-7c1a-5bf6-a933-1453c9b2b7c7 with identifier: AX05143
2026-03-28 07:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2a0d621-7c1a-5bf6-a933-1453c9b2b7c7 with identifier: AX05143
2026-03-28 07:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2a0d621-7c1a-5bf6-a933-1453c9b2b7c7 with identifier: AX05143 to the API
2026-03-28 07:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-28T16:03:35Z',
'fuel_type': 'petrol',
'id': 'f2a0d621-7c1a-5bf6-a933-1453c9b2b7c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX05143',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 152584,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-26',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2009}
2026-03-28 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX05143%27 HTTP/1.1" 200 None
2026-03-28 07:38:47 [auto1.de] INFO: Saving data for AX05143: {'auction_closing_time': 1774713815.0, 'created_time': 1773830016.301021, 'last_price_update_time': 1774683527.483843}
2026-03-28 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX05143') HTTP/1.1" 204 0
2026-03-28 07:38:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:38:47 [auto1.de] INFO: Found listing with ID: GR51738
2026-03-28 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR51738%27 HTTP/1.1" 200 None
2026-03-28 07:38:47 [auto1.de] INFO: Scrape type for GR51738: 0
2026-03-28 07:38:47 [auto1.de] INFO: Found listing with ID: MM64069
2026-03-28 07:38:47 [auto1.de] INFO: Found listing with ID: JS64432
2026-03-28 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS64432%27 HTTP/1.1" 200 None
2026-03-28 07:38:47 [auto1.de] INFO: Scrape type for JS64432: 0
2026-03-28 07:38:47 [auto1.de] INFO: Found listing with ID: YU84960
2026-03-28 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU84960%27 HTTP/1.1" 200 None
2026-03-28 07:38:47 [auto1.de] INFO: Scrape type for YU84960: 0
2026-03-28 07:38:47 [auto1.de] INFO: Found listing with ID: BV96040
2026-03-28 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96040%27 HTTP/1.1" 200 None
2026-03-28 07:38:47 [auto1.de] INFO: Scrape type for BV96040: 0
2026-03-28 07:38:47 [auto1.de] INFO: Found listing with ID: NV66174
2026-03-28 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV66174%27 HTTP/1.1" 200 None
2026-03-28 07:38:47 [auto1.de] INFO: Scrape type for NV66174: 2
2026-03-28 07:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15f5daa8-07fe-5539-ad3c-ab73959a0867 with identifier: NV66174
2026-03-28 07:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15f5daa8-07fe-5539-ad3c-ab73959a0867 with scrape type 2
2026-03-28 07:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15f5daa8-07fe-5539-ad3c-ab73959a0867 with scrape type 2
2026-03-28 07:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15f5daa8-07fe-5539-ad3c-ab73959a0867, identifier: NV66174
2026-03-28 07:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15f5daa8-07fe-5539-ad3c-ab73959a0867 with identifier: NV66174
2026-03-28 07:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15f5daa8-07fe-5539-ad3c-ab73959a0867 with identifier: NV66174
2026-03-28 07:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15f5daa8-07fe-5539-ad3c-ab73959a0867 with identifier: NV66174 to the API
2026-03-28 07:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 145,
'expiration_date': '2026-03-28T16:14:59Z',
'fuel_type': 'diesel',
'id': '15f5daa8-07fe-5539-ad3c-ab73959a0867',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV66174',
'listing': 'auction',
'make': 'Opel',
'model': 'Vivaro',
'odometer': 178827,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-26',
'seller_name': None,
'title': 'Opel Vivaro 1.6 Biturbo CDTI Combi L2H1 2,9t',
'transmission': 'manual',
'trim': 'Combi L2H1 2,9t',
'year': 2017}
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV66174%27 HTTP/1.1" 200 None
2026-03-28 07:38:48 [auto1.de] INFO: Saving data for NV66174: {'auction_closing_time': 1774714499.0, 'created_time': 1773860743.841551, 'last_price_update_time': 1774683528.023915}
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV66174') HTTP/1.1" 204 0
2026-03-28 07:38:48 [auto1.de] INFO: Found listing with ID: EU27466
2026-03-28 07:38:48 [auto1.de] INFO: Found listing with ID: SP32768
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP32768%27 HTTP/1.1" 200 None
2026-03-28 07:38:48 [auto1.de] INFO: Scrape type for SP32768: 0
2026-03-28 07:38:48 [auto1.de] INFO: Found listing with ID: BG47316
2026-03-28 07:38:48 [auto1.de] INFO: Found listing with ID: BU31051
2026-03-28 07:38:48 [auto1.de] INFO: Found listing with ID: TE51742
2026-03-28 07:38:48 [auto1.de] INFO: Found listing with ID: RG99680
2026-03-28 07:38:48 [auto1.de] INFO: Found listing with ID: AX75874
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX75874%27 HTTP/1.1" 200 None
2026-03-28 07:38:48 [auto1.de] INFO: Scrape type for AX75874: 0
2026-03-28 07:38:48 [auto1.de] INFO: Found listing with ID: GS24649
2026-03-28 07:38:48 [auto1.de] INFO: Found listing with ID: RS08220
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS08220%27 HTTP/1.1" 200 None
2026-03-28 07:38:48 [auto1.de] INFO: Scrape type for RS08220: 0
2026-03-28 07:38:48 [auto1.de] INFO: Found listing with ID: MV56275
2026-03-28 07:38:48 [auto1.de] INFO: Found listing with ID: RL20580
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL20580%27 HTTP/1.1" 200 None
2026-03-28 07:38:48 [auto1.de] INFO: Scrape type for RL20580: 0
2026-03-28 07:38:48 [auto1.de] INFO: Found listing with ID: LZ64363
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ64363%27 HTTP/1.1" 200 None
2026-03-28 07:38:48 [auto1.de] INFO: Scrape type for LZ64363: 0
2026-03-28 07:38:48 [auto1.de] INFO: Found listing with ID: NA10756
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA10756%27 HTTP/1.1" 200 None
2026-03-28 07:38:48 [auto1.de] INFO: Scrape type for NA10756: 0
2026-03-28 07:38:48 [auto1.de] INFO: Found listing with ID: VA23337
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA23337%27 HTTP/1.1" 200 None
2026-03-28 07:38:48 [auto1.de] INFO: Scrape type for VA23337: 2
2026-03-28 07:38:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d773dbd1-88cc-5a8b-8544-3f3b160f6973 with identifier: VA23337
2026-03-28 07:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d773dbd1-88cc-5a8b-8544-3f3b160f6973 with scrape type 2
2026-03-28 07:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d773dbd1-88cc-5a8b-8544-3f3b160f6973 with scrape type 2
2026-03-28 07:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d773dbd1-88cc-5a8b-8544-3f3b160f6973, identifier: VA23337
2026-03-28 07:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d773dbd1-88cc-5a8b-8544-3f3b160f6973 with identifier: VA23337
2026-03-28 07:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d773dbd1-88cc-5a8b-8544-3f3b160f6973 with identifier: VA23337
2026-03-28 07:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d773dbd1-88cc-5a8b-8544-3f3b160f6973 with identifier: VA23337 to the API
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-28T16:35:33Z',
'fuel_type': 'petrol',
'id': 'd773dbd1-88cc-5a8b-8544-3f3b160f6973',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA23337',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 243029,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-04',
'seller_name': None,
'title': 'Skoda Superb 2.0 TSI Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2012}
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA23337%27 HTTP/1.1" 200 None
2026-03-28 07:38:48 [auto1.de] INFO: Saving data for VA23337: {'auction_closing_time': 1774715733.0, 'created_time': 1774466875.409391, 'last_price_update_time': 1774683528.567594}
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VA23337') HTTP/1.1" 204 0
2026-03-28 07:38:48 [auto1.de] INFO: Found listing with ID: ED87662
2026-03-28 07:38:48 [auto1.de] INFO: Found listing with ID: ZT91138
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT91138%27 HTTP/1.1" 200 None
2026-03-28 07:38:48 [auto1.de] INFO: Scrape type for ZT91138: 2
2026-03-28 07:38:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11b7415d-b7e0-5910-bbdd-6959f3ed2058 with identifier: ZT91138
2026-03-28 07:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11b7415d-b7e0-5910-bbdd-6959f3ed2058 with scrape type 2
2026-03-28 07:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11b7415d-b7e0-5910-bbdd-6959f3ed2058 with scrape type 2
2026-03-28 07:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11b7415d-b7e0-5910-bbdd-6959f3ed2058, identifier: ZT91138
2026-03-28 07:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11b7415d-b7e0-5910-bbdd-6959f3ed2058 with identifier: ZT91138
2026-03-28 07:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11b7415d-b7e0-5910-bbdd-6959f3ed2058 with identifier: ZT91138
2026-03-28 07:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11b7415d-b7e0-5910-bbdd-6959f3ed2058 with identifier: ZT91138 to the API
2026-03-28 07:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:33:50Z',
'fuel_type': 'petrol',
'id': '11b7415d-b7e0-5910-bbdd-6959f3ed2058',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT91138',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'up!',
'odometer': 90724,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-05',
'seller_name': None,
'title': 'Volkswagen up! 1.0 Move up! BlueMotion',
'transmission': 'automatic',
'trim': 'Move BlueMotion',
'year': 2019}
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT91138%27 HTTP/1.1" 200 None
2026-03-28 07:38:49 [auto1.de] INFO: Saving data for ZT91138: {'auction_closing_time': 1774715630.0, 'created_time': 1774464471.175556, 'last_price_update_time': 1774683529.116982}
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT91138') HTTP/1.1" 204 0
2026-03-28 07:38:49 [auto1.de] INFO: Found listing with ID: BR62242
2026-03-28 07:38:49 [auto1.de] INFO: Found listing with ID: ND31519
2026-03-28 07:38:49 [auto1.de] INFO: Found listing with ID: EB29224
2026-03-28 07:38:49 [auto1.de] INFO: Found listing with ID: WS70576
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS70576%27 HTTP/1.1" 200 None
2026-03-28 07:38:49 [auto1.de] INFO: Scrape type for WS70576: 0
2026-03-28 07:38:49 [auto1.de] INFO: Found listing with ID: MU06950
2026-03-28 07:38:49 [auto1.de] INFO: Found listing with ID: HT55268
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT55268%27 HTTP/1.1" 200 None
2026-03-28 07:38:49 [auto1.de] INFO: Scrape type for HT55268: 0
2026-03-28 07:38:49 [auto1.de] INFO: Found listing with ID: EL91395
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL91395%27 HTTP/1.1" 200 None
2026-03-28 07:38:49 [auto1.de] INFO: Scrape type for EL91395: 0
2026-03-28 07:38:49 [auto1.de] INFO: Found listing with ID: GL43025
2026-03-28 07:38:49 [auto1.de] INFO: Found listing with ID: LR55805
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR55805%27 HTTP/1.1" 200 None
2026-03-28 07:38:49 [auto1.de] INFO: Scrape type for LR55805: 2
2026-03-28 07:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f42babea-f928-5994-8f54-ab2519e7fb20 with identifier: LR55805
2026-03-28 07:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f42babea-f928-5994-8f54-ab2519e7fb20 with scrape type 2
2026-03-28 07:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f42babea-f928-5994-8f54-ab2519e7fb20 with scrape type 2
2026-03-28 07:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f42babea-f928-5994-8f54-ab2519e7fb20, identifier: LR55805
2026-03-28 07:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f42babea-f928-5994-8f54-ab2519e7fb20 with identifier: LR55805
2026-03-28 07:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f42babea-f928-5994-8f54-ab2519e7fb20 with identifier: LR55805
2026-03-28 07:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f42babea-f928-5994-8f54-ab2519e7fb20 with identifier: LR55805 to the API
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 300,
'expiration_date': '2026-03-28T16:34:02Z',
'fuel_type': 'petrol',
'id': 'f42babea-f928-5994-8f54-ab2519e7fb20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR55805',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 42924,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-31',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TSI GTI Clubsport',
'transmission': 'automatic',
'trim': 'GTI Clubsport',
'year': 2022}
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR55805%27 HTTP/1.1" 200 None
2026-03-28 07:38:49 [auto1.de] INFO: Saving data for LR55805: {'auction_closing_time': 1774715642.0, 'created_time': 1774467696.891815, 'last_price_update_time': 1774683529.606402}
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR55805') HTTP/1.1" 204 0
2026-03-28 07:38:49 [auto1.de] INFO: Found listing with ID: CG60356
2026-03-28 07:38:49 [auto1.de] INFO: Found listing with ID: NC69837
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC69837%27 HTTP/1.1" 200 None
2026-03-28 07:38:49 [auto1.de] INFO: Scrape type for NC69837: 0
2026-03-28 07:38:49 [auto1.de] INFO: Found listing with ID: CR76399
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR76399%27 HTTP/1.1" 200 None
2026-03-28 07:38:49 [auto1.de] INFO: Scrape type for CR76399: 0
2026-03-28 07:38:49 [auto1.de] INFO: Found listing with ID: WK00710
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK00710%27 HTTP/1.1" 200 None
2026-03-28 07:38:49 [auto1.de] INFO: Scrape type for WK00710: 0
2026-03-28 07:38:49 [auto1.de] INFO: Found listing with ID: LT87510
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT87510%27 HTTP/1.1" 200 None
2026-03-28 07:38:49 [auto1.de] INFO: Scrape type for LT87510: 0
2026-03-28 07:38:49 [auto1.de] INFO: Found listing with ID: ZR08367
2026-03-28 07:38:49 [auto1.de] INFO: Found listing with ID: BW06665
2026-03-28 07:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:38:50 [auto1.de] INFO: Channel: 24h | Page: 107 | totalHits: 9260 | hits on page: 40
2026-03-28 07:38:50 [auto1.de] INFO: Found listing with ID: BW06665
2026-03-28 07:38:50 [auto1.de] INFO: Found listing with ID: BV90927
2026-03-28 07:38:50 [auto1.de] INFO: Found listing with ID: LD74655
2026-03-28 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD74655%27 HTTP/1.1" 200 None
2026-03-28 07:38:50 [auto1.de] INFO: Scrape type for LD74655: 0
2026-03-28 07:38:50 [auto1.de] INFO: Found listing with ID: AU29574
2026-03-28 07:38:50 [auto1.de] INFO: Found listing with ID: LM65356
2026-03-28 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM65356%27 HTTP/1.1" 200 None
2026-03-28 07:38:50 [auto1.de] INFO: Scrape type for LM65356: 0
2026-03-28 07:38:50 [auto1.de] INFO: Found listing with ID: LE59540
2026-03-28 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE59540%27 HTTP/1.1" 200 None
2026-03-28 07:38:50 [auto1.de] INFO: Scrape type for LE59540: 0
2026-03-28 07:38:50 [auto1.de] INFO: Found listing with ID: CM68518
2026-03-28 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM68518%27 HTTP/1.1" 200 None
2026-03-28 07:38:50 [auto1.de] INFO: Scrape type for CM68518: 0
2026-03-28 07:38:50 [auto1.de] INFO: Found listing with ID: ME72354
2026-03-28 07:38:50 [auto1.de] INFO: Found listing with ID: KJ04555
2026-03-28 07:38:50 [auto1.de] INFO: Found listing with ID: PR68171
2026-03-28 07:38:50 [auto1.de] INFO: Found listing with ID: GA84874
2026-03-28 07:38:50 [auto1.de] INFO: Found listing with ID: WW51915
2026-03-28 07:38:50 [auto1.de] INFO: Found listing with ID: NK09609
2026-03-28 07:38:50 [auto1.de] INFO: Found listing with ID: NH48302
2026-03-28 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH48302%27 HTTP/1.1" 200 None
2026-03-28 07:38:50 [auto1.de] INFO: Scrape type for NH48302: 2
2026-03-28 07:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d7ce857-2f66-58b4-98d2-d231997745f2 with identifier: NH48302
2026-03-28 07:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d7ce857-2f66-58b4-98d2-d231997745f2 with scrape type 2
2026-03-28 07:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d7ce857-2f66-58b4-98d2-d231997745f2 with scrape type 2
2026-03-28 07:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d7ce857-2f66-58b4-98d2-d231997745f2, identifier: NH48302
2026-03-28 07:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d7ce857-2f66-58b4-98d2-d231997745f2 with identifier: NH48302
2026-03-28 07:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d7ce857-2f66-58b4-98d2-d231997745f2 with identifier: NH48302
2026-03-28 07:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d7ce857-2f66-58b4-98d2-d231997745f2 with identifier: NH48302 to the API
2026-03-28 07:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:36:59Z',
'fuel_type': 'petrol',
'id': '0d7ce857-2f66-58b4-98d2-d231997745f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH48302',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Cross',
'odometer': 35639,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-03',
'seller_name': None,
'title': 'Volkswagen T-Cross 1.5 TSI ACT Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2022}
2026-03-28 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH48302%27 HTTP/1.1" 200 None
2026-03-28 07:38:51 [auto1.de] INFO: Saving data for NH48302: {'auction_closing_time': 1774715819.0, 'created_time': 1773829885.566613, 'last_price_update_time': 1774683531.305024}
2026-03-28 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH48302') HTTP/1.1" 204 0
2026-03-28 07:38:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:38:51 [auto1.de] INFO: Found listing with ID: FU90686
2026-03-28 07:38:51 [auto1.de] INFO: Found listing with ID: LR95574
2026-03-28 07:38:51 [auto1.de] INFO: Found listing with ID: VZ82726
2026-03-28 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ82726%27 HTTP/1.1" 200 None
2026-03-28 07:38:51 [auto1.de] INFO: Scrape type for VZ82726: 2
2026-03-28 07:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b98043e5-5d14-5632-820a-b08079ab85a1 with identifier: VZ82726
2026-03-28 07:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b98043e5-5d14-5632-820a-b08079ab85a1 with scrape type 2
2026-03-28 07:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b98043e5-5d14-5632-820a-b08079ab85a1 with scrape type 2
2026-03-28 07:38:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b98043e5-5d14-5632-820a-b08079ab85a1, identifier: VZ82726
2026-03-28 07:38:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b98043e5-5d14-5632-820a-b08079ab85a1 with identifier: VZ82726
2026-03-28 07:38:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b98043e5-5d14-5632-820a-b08079ab85a1 with identifier: VZ82726
2026-03-28 07:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b98043e5-5d14-5632-820a-b08079ab85a1 with identifier: VZ82726 to the API
2026-03-28 07:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 88,
'expiration_date': '2026-03-28T16:45:12Z',
'fuel_type': 'petrol',
'id': 'b98043e5-5d14-5632-820a-b08079ab85a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ82726',
'listing': 'auction',
'make': 'Renault',
'model': 'Modus',
'odometer': 121671,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-04-26',
'seller_name': None,
'title': 'Renault Modus 1.6 Exception',
'transmission': 'manual',
'trim': 'Exception',
'year': 2007}
2026-03-28 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ82726%27 HTTP/1.1" 200 None
2026-03-28 07:38:51 [auto1.de] INFO: Saving data for VZ82726: {'auction_closing_time': 1774716312.0, 'created_time': 1774467035.353746, 'last_price_update_time': 1774683531.821261}
2026-03-28 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ82726') HTTP/1.1" 204 0
2026-03-28 07:38:51 [auto1.de] INFO: Found listing with ID: CS72322
2026-03-28 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS72322%27 HTTP/1.1" 200 None
2026-03-28 07:38:51 [auto1.de] INFO: Scrape type for CS72322: 2
2026-03-28 07:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 386b67a2-bc76-5adf-a723-feb252a8f36f with identifier: CS72322
2026-03-28 07:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 386b67a2-bc76-5adf-a723-feb252a8f36f with scrape type 2
2026-03-28 07:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 386b67a2-bc76-5adf-a723-feb252a8f36f with scrape type 2
2026-03-28 07:38:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 386b67a2-bc76-5adf-a723-feb252a8f36f, identifier: CS72322
2026-03-28 07:38:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 386b67a2-bc76-5adf-a723-feb252a8f36f with identifier: CS72322
2026-03-28 07:38:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 386b67a2-bc76-5adf-a723-feb252a8f36f with identifier: CS72322
2026-03-28 07:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 386b67a2-bc76-5adf-a723-feb252a8f36f with identifier: CS72322 to the API
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:07:39Z',
'fuel_type': 'diesel',
'id': '386b67a2-bc76-5adf-a723-feb252a8f36f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS72322',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII Sportsvan',
'odometer': 101493,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-16',
'seller_name': None,
'title': 'Volkswagen Golf VII Sportsvan 1.6 TDI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2014}
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS72322%27 HTTP/1.1" 200 None
2026-03-28 07:38:52 [auto1.de] INFO: Saving data for CS72322: {'auction_closing_time': 1774714059.0, 'created_time': 1774466934.925993, 'last_price_update_time': 1774683532.26899}
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS72322') HTTP/1.1" 204 0
2026-03-28 07:38:52 [auto1.de] INFO: Found listing with ID: ZR98905
2026-03-28 07:38:52 [auto1.de] INFO: Found listing with ID: EL53532
2026-03-28 07:38:52 [auto1.de] INFO: Found listing with ID: JN87452
2026-03-28 07:38:52 [auto1.de] INFO: Found listing with ID: EZ97284
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ97284%27 HTTP/1.1" 200 None
2026-03-28 07:38:52 [auto1.de] INFO: Scrape type for EZ97284: 0
2026-03-28 07:38:52 [auto1.de] INFO: Found listing with ID: SJ63843
2026-03-28 07:38:52 [auto1.de] INFO: Found listing with ID: VZ68210
2026-03-28 07:38:52 [auto1.de] INFO: Found listing with ID: PM53589
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM53589%27 HTTP/1.1" 200 None
2026-03-28 07:38:52 [auto1.de] INFO: Scrape type for PM53589: 0
2026-03-28 07:38:52 [auto1.de] INFO: Found listing with ID: MP93113
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP93113%27 HTTP/1.1" 200 None
2026-03-28 07:38:52 [auto1.de] INFO: Scrape type for MP93113: 0
2026-03-28 07:38:52 [auto1.de] INFO: Found listing with ID: VX98591
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX98591%27 HTTP/1.1" 200 None
2026-03-28 07:38:52 [auto1.de] INFO: Scrape type for VX98591: 0
2026-03-28 07:38:52 [auto1.de] INFO: Found listing with ID: GM26241
2026-03-28 07:38:52 [auto1.de] INFO: Found listing with ID: BE80399
2026-03-28 07:38:52 [auto1.de] INFO: Found listing with ID: RE64709
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE64709%27 HTTP/1.1" 200 None
2026-03-28 07:38:52 [auto1.de] INFO: Scrape type for RE64709: 0
2026-03-28 07:38:52 [auto1.de] INFO: Found listing with ID: AJ85429
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ85429%27 HTTP/1.1" 200 None
2026-03-28 07:38:52 [auto1.de] INFO: Scrape type for AJ85429: 0
2026-03-28 07:38:52 [auto1.de] INFO: Found listing with ID: LH84474
2026-03-28 07:38:52 [auto1.de] INFO: Found listing with ID: DE92254
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE92254%27 HTTP/1.1" 200 None
2026-03-28 07:38:52 [auto1.de] INFO: Scrape type for DE92254: 2
2026-03-28 07:38:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 150a7f73-3cff-5d05-a2bc-2111649a9ae9 with identifier: DE92254
2026-03-28 07:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 150a7f73-3cff-5d05-a2bc-2111649a9ae9 with scrape type 2
2026-03-28 07:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 150a7f73-3cff-5d05-a2bc-2111649a9ae9 with scrape type 2
2026-03-28 07:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 150a7f73-3cff-5d05-a2bc-2111649a9ae9, identifier: DE92254
2026-03-28 07:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 150a7f73-3cff-5d05-a2bc-2111649a9ae9 with identifier: DE92254
2026-03-28 07:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 150a7f73-3cff-5d05-a2bc-2111649a9ae9 with identifier: DE92254
2026-03-28 07:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 150a7f73-3cff-5d05-a2bc-2111649a9ae9 with identifier: DE92254 to the API
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:55:47Z',
'fuel_type': 'diesel',
'id': '150a7f73-3cff-5d05-a2bc-2111649a9ae9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE92254',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 148388,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-19',
'seller_name': None,
'title': 'Peugeot 308 2.0 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2016}
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE92254%27 HTTP/1.1" 200 None
2026-03-28 07:38:52 [auto1.de] INFO: Saving data for DE92254: {'auction_closing_time': 1774716947.0, 'created_time': 1774467382.399256, 'last_price_update_time': 1774683532.786359}
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE92254') HTTP/1.1" 204 0
2026-03-28 07:38:52 [auto1.de] INFO: Found listing with ID: CL77632
2026-03-28 07:38:52 [auto1.de] INFO: Found listing with ID: PJ34176
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34176%27 HTTP/1.1" 200 None
2026-03-28 07:38:52 [auto1.de] INFO: Scrape type for PJ34176: 0
2026-03-28 07:38:52 [auto1.de] INFO: Found listing with ID: GA94662
2026-03-28 07:38:52 [auto1.de] INFO: Found listing with ID: CT29846
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT29846%27 HTTP/1.1" 200 None
2026-03-28 07:38:52 [auto1.de] INFO: Scrape type for CT29846: 2
2026-03-28 07:38:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4281f299-0c40-58ed-ba71-85ca0d10c008 with identifier: CT29846
2026-03-28 07:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4281f299-0c40-58ed-ba71-85ca0d10c008 with scrape type 2
2026-03-28 07:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4281f299-0c40-58ed-ba71-85ca0d10c008 with scrape type 2
2026-03-28 07:38:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4281f299-0c40-58ed-ba71-85ca0d10c008, identifier: CT29846
2026-03-28 07:38:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4281f299-0c40-58ed-ba71-85ca0d10c008 with identifier: CT29846
2026-03-28 07:38:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4281f299-0c40-58ed-ba71-85ca0d10c008 with identifier: CT29846
2026-03-28 07:38:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4281f299-0c40-58ed-ba71-85ca0d10c008 with identifier: CT29846 to the API
2026-03-28 07:38:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 145,
'expiration_date': '2026-03-28T16:40:33Z',
'fuel_type': 'petrol',
'id': '4281f299-0c40-58ed-ba71-85ca0d10c008',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT29846',
'listing': 'auction',
'make': 'Mazda',
'model': '5',
'odometer': 178233,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-04',
'seller_name': None,
'title': 'Mazda 5 2.0 Top',
'transmission': 'manual',
'trim': 'Top',
'year': 2009}
2026-03-28 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT29846%27 HTTP/1.1" 200 None
2026-03-28 07:38:53 [auto1.de] INFO: Saving data for CT29846: {'auction_closing_time': 1774716033.0, 'created_time': 1774466429.250155, 'last_price_update_time': 1774683533.377306}
2026-03-28 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT29846') HTTP/1.1" 204 0
2026-03-28 07:38:53 [auto1.de] INFO: Found listing with ID: PM22977
2026-03-28 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM22977%27 HTTP/1.1" 200 None
2026-03-28 07:38:53 [auto1.de] INFO: Scrape type for PM22977: 0
2026-03-28 07:38:53 [auto1.de] INFO: Found listing with ID: PG24274
2026-03-28 07:38:53 [auto1.de] INFO: Found listing with ID: ED27900
2026-03-28 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED27900%27 HTTP/1.1" 200 None
2026-03-28 07:38:53 [auto1.de] INFO: Scrape type for ED27900: 0
2026-03-28 07:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:38:54 [auto1.de] INFO: Channel: 24h | Page: 108 | totalHits: 9260 | hits on page: 40
2026-03-28 07:38:54 [auto1.de] INFO: Found listing with ID: XW75197
2026-03-28 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW75197%27 HTTP/1.1" 200 None
2026-03-28 07:38:54 [auto1.de] INFO: Scrape type for XW75197: 2
2026-03-28 07:38:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5e376c3-94af-5b99-a2f4-4c304f2146f7 with identifier: XW75197
2026-03-28 07:38:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5e376c3-94af-5b99-a2f4-4c304f2146f7 with scrape type 2
2026-03-28 07:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5e376c3-94af-5b99-a2f4-4c304f2146f7 with scrape type 2
2026-03-28 07:38:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5e376c3-94af-5b99-a2f4-4c304f2146f7, identifier: XW75197
2026-03-28 07:38:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5e376c3-94af-5b99-a2f4-4c304f2146f7 with identifier: XW75197
2026-03-28 07:38:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5e376c3-94af-5b99-a2f4-4c304f2146f7 with identifier: XW75197
2026-03-28 07:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5e376c3-94af-5b99-a2f4-4c304f2146f7 with identifier: XW75197 to the API
2026-03-28 07:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:49:21Z',
'fuel_type': 'petrol',
'id': 'c5e376c3-94af-5b99-a2f4-4c304f2146f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW75197',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 51456,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-19',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 TSI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2020}
2026-03-28 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW75197%27 HTTP/1.1" 200 None
2026-03-28 07:38:55 [auto1.de] INFO: Saving data for XW75197: {'auction_closing_time': 1774716561.0, 'created_time': 1774464421.361803, 'last_price_update_time': 1774683535.05708}
2026-03-28 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW75197') HTTP/1.1" 204 0
2026-03-28 07:38:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:38:55 [auto1.de] INFO: Found listing with ID: LA89414
2026-03-28 07:38:55 [auto1.de] INFO: Found listing with ID: LJ68235
2026-03-28 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ68235%27 HTTP/1.1" 200 None
2026-03-28 07:38:55 [auto1.de] INFO: Scrape type for LJ68235: 0
2026-03-28 07:38:55 [auto1.de] INFO: Found listing with ID: VW14529
2026-03-28 07:38:55 [auto1.de] INFO: Found listing with ID: MV76572
2026-03-28 07:38:55 [auto1.de] INFO: Found listing with ID: KY77386
2026-03-28 07:38:55 [auto1.de] INFO: Found listing with ID: JS34798
2026-03-28 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS34798%27 HTTP/1.1" 200 None
2026-03-28 07:38:55 [auto1.de] INFO: Scrape type for JS34798: 0
2026-03-28 07:38:55 [auto1.de] INFO: Found listing with ID: HE06850
2026-03-28 07:38:55 [auto1.de] INFO: Found listing with ID: RU20200
2026-03-28 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU20200%27 HTTP/1.1" 200 None
2026-03-28 07:38:55 [auto1.de] INFO: Scrape type for RU20200: 2
2026-03-28 07:38:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 999e31aa-46d5-5f6a-8947-bdd04521c98c with identifier: RU20200
2026-03-28 07:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 999e31aa-46d5-5f6a-8947-bdd04521c98c with scrape type 2
2026-03-28 07:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 999e31aa-46d5-5f6a-8947-bdd04521c98c with scrape type 2
2026-03-28 07:38:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 999e31aa-46d5-5f6a-8947-bdd04521c98c, identifier: RU20200
2026-03-28 07:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 999e31aa-46d5-5f6a-8947-bdd04521c98c with identifier: RU20200
2026-03-28 07:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 999e31aa-46d5-5f6a-8947-bdd04521c98c with identifier: RU20200
2026-03-28 07:38:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 999e31aa-46d5-5f6a-8947-bdd04521c98c with identifier: RU20200 to the API
2026-03-28 07:38:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:43:49Z',
'fuel_type': 'petrol',
'id': '999e31aa-46d5-5f6a-8947-bdd04521c98c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU20200',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 108922,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-02',
'seller_name': None,
'title': 'BMW 1er 118i Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2015}
2026-03-28 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU20200%27 HTTP/1.1" 200 None
2026-03-28 07:38:55 [auto1.de] INFO: Saving data for RU20200: {'auction_closing_time': 1774716229.0, 'created_time': 1774464284.950647, 'last_price_update_time': 1774683535.560102}
2026-03-28 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU20200') HTTP/1.1" 204 0
2026-03-28 07:38:55 [auto1.de] INFO: Found listing with ID: PW87912
2026-03-28 07:38:55 [auto1.de] INFO: Found listing with ID: CS57817
2026-03-28 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS57817%27 HTTP/1.1" 200 None
2026-03-28 07:38:55 [auto1.de] INFO: Scrape type for CS57817: 0
2026-03-28 07:38:55 [auto1.de] INFO: Found listing with ID: TX62945
2026-03-28 07:38:55 [auto1.de] INFO: Found listing with ID: SR33792
2026-03-28 07:38:55 [auto1.de] INFO: Found listing with ID: VK33233
2026-03-28 07:38:55 [auto1.de] INFO: Found listing with ID: VW53708
2026-03-28 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW53708%27 HTTP/1.1" 200 None
2026-03-28 07:38:55 [auto1.de] INFO: Scrape type for VW53708: 2
2026-03-28 07:38:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec3e2b33-c253-5152-a61a-6e6f0ceaf619 with identifier: VW53708
2026-03-28 07:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec3e2b33-c253-5152-a61a-6e6f0ceaf619 with scrape type 2
2026-03-28 07:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec3e2b33-c253-5152-a61a-6e6f0ceaf619 with scrape type 2
2026-03-28 07:38:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec3e2b33-c253-5152-a61a-6e6f0ceaf619, identifier: VW53708
2026-03-28 07:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec3e2b33-c253-5152-a61a-6e6f0ceaf619 with identifier: VW53708
2026-03-28 07:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec3e2b33-c253-5152-a61a-6e6f0ceaf619 with identifier: VW53708
2026-03-28 07:38:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec3e2b33-c253-5152-a61a-6e6f0ceaf619 with identifier: VW53708 to the API
2026-03-28 07:38:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 333,
'expiration_date': '2026-03-28T16:54:09Z',
'fuel_type': 'petrol',
'id': 'ec3e2b33-c253-5152-a61a-6e6f0ceaf619',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW53708',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 18422,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-03-27',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TSI R Performance 4Motion',
'transmission': 'automatic',
'trim': 'R Performance 4Motion',
'year': 2024}
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW53708%27 HTTP/1.1" 200 None
2026-03-28 07:38:56 [auto1.de] INFO: Saving data for VW53708: {'auction_closing_time': 1774716849.0, 'created_time': 1774466612.604455, 'last_price_update_time': 1774683536.112745}
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW53708') HTTP/1.1" 204 0
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: GH07682
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: VA97546
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA97546%27 HTTP/1.1" 200 None
2026-03-28 07:38:56 [auto1.de] INFO: Scrape type for VA97546: 0
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: WN72573
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN72573%27 HTTP/1.1" 200 None
2026-03-28 07:38:56 [auto1.de] INFO: Scrape type for WN72573: 0
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: VL48750
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL48750%27 HTTP/1.1" 200 None
2026-03-28 07:38:56 [auto1.de] INFO: Scrape type for VL48750: 0
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: BG60568
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG60568%27 HTTP/1.1" 200 None
2026-03-28 07:38:56 [auto1.de] INFO: Scrape type for BG60568: 0
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: HP43696
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: CB52035
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB52035%27 HTTP/1.1" 200 None
2026-03-28 07:38:56 [auto1.de] INFO: Scrape type for CB52035: 0
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: MB83489
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: KH64272
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: DP86097
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: TF55396
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF55396%27 HTTP/1.1" 200 None
2026-03-28 07:38:56 [auto1.de] INFO: Scrape type for TF55396: 2
2026-03-28 07:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bf0670c-b75f-5a69-a282-18addae625f8 with identifier: TF55396
2026-03-28 07:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bf0670c-b75f-5a69-a282-18addae625f8 with scrape type 2
2026-03-28 07:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bf0670c-b75f-5a69-a282-18addae625f8 with scrape type 2
2026-03-28 07:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0bf0670c-b75f-5a69-a282-18addae625f8, identifier: TF55396
2026-03-28 07:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0bf0670c-b75f-5a69-a282-18addae625f8 with identifier: TF55396
2026-03-28 07:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0bf0670c-b75f-5a69-a282-18addae625f8 with identifier: TF55396
2026-03-28 07:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0bf0670c-b75f-5a69-a282-18addae625f8 with identifier: TF55396 to the API
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-28T16:55:11Z',
'fuel_type': 'hybrid',
'id': '0bf0670c-b75f-5a69-a282-18addae625f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF55396',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 60318,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-07',
'seller_name': None,
'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
'transmission': 'automatic',
'trim': 'ST-Line X',
'year': 2022}
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF55396%27 HTTP/1.1" 200 None
2026-03-28 07:38:56 [auto1.de] INFO: Saving data for TF55396: {'auction_closing_time': 1774716911.0, 'created_time': 1774465698.873063, 'last_price_update_time': 1774683536.648165}
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF55396') HTTP/1.1" 204 0
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: KV18846
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: BS18924
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: CK27476
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK27476%27 HTTP/1.1" 200 None
2026-03-28 07:38:56 [auto1.de] INFO: Scrape type for CK27476: 0
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: CY25945
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: DH62820
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: GJ72633
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ72633%27 HTTP/1.1" 200 None
2026-03-28 07:38:56 [auto1.de] INFO: Scrape type for GJ72633: 0
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: SL64623
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL64623%27 HTTP/1.1" 200 None
2026-03-28 07:38:56 [auto1.de] INFO: Scrape type for SL64623: 0
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: SZ82893
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: NB86362
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: AM60777
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: SK30483
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK30483%27 HTTP/1.1" 200 None
2026-03-28 07:38:56 [auto1.de] INFO: Scrape type for SK30483: 0
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: WT98226
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: WW97819
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW97819%27 HTTP/1.1" 200 None
2026-03-28 07:38:56 [auto1.de] INFO: Scrape type for WW97819: 0
2026-03-28 07:38:56 [auto1.de] INFO: Found listing with ID: UN48068
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN48068%27 HTTP/1.1" 200 None
2026-03-28 07:38:56 [auto1.de] INFO: Scrape type for UN48068: 0
2026-03-28 07:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:38:57 [auto1.de] INFO: Channel: 24h | Page: 109 | totalHits: 9260 | hits on page: 40
2026-03-28 07:38:57 [auto1.de] INFO: Found listing with ID: MH25393
2026-03-28 07:38:57 [auto1.de] INFO: Found listing with ID: SR72775
2026-03-28 07:38:57 [auto1.de] INFO: Found listing with ID: NF21542
2026-03-28 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF21542%27 HTTP/1.1" 200 None
2026-03-28 07:38:57 [auto1.de] INFO: Scrape type for NF21542: 0
2026-03-28 07:38:57 [auto1.de] INFO: Found listing with ID: YG95815
2026-03-28 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG95815%27 HTTP/1.1" 200 None
2026-03-28 07:38:57 [auto1.de] INFO: Scrape type for YG95815: 0
2026-03-28 07:38:57 [auto1.de] INFO: Found listing with ID: PA80529
2026-03-28 07:38:57 [auto1.de] INFO: Found listing with ID: GZ27207
2026-03-28 07:38:57 [auto1.de] INFO: Found listing with ID: BH72065
2026-03-28 07:38:57 [auto1.de] INFO: Found listing with ID: CY45921
2026-03-28 07:38:57 [auto1.de] INFO: Found listing with ID: LN75673
2026-03-28 07:38:57 [auto1.de] INFO: Found listing with ID: YP78886
2026-03-28 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP78886%27 HTTP/1.1" 200 None
2026-03-28 07:38:57 [auto1.de] INFO: Scrape type for YP78886: 0
2026-03-28 07:38:57 [auto1.de] INFO: Found listing with ID: GG82433
2026-03-28 07:38:57 [auto1.de] INFO: Found listing with ID: US88233
2026-03-28 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US88233%27 HTTP/1.1" 200 None
2026-03-28 07:38:57 [auto1.de] INFO: Scrape type for US88233: 0
2026-03-28 07:38:57 [auto1.de] INFO: Found listing with ID: AL03330
2026-03-28 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL03330%27 HTTP/1.1" 200 None
2026-03-28 07:38:57 [auto1.de] INFO: Scrape type for AL03330: 0
2026-03-28 07:38:57 [auto1.de] INFO: Found listing with ID: HH06694
2026-03-28 07:38:57 [auto1.de] INFO: Found listing with ID: HA17453
2026-03-28 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA17453%27 HTTP/1.1" 200 None
2026-03-28 07:38:57 [auto1.de] INFO: Scrape type for HA17453: 2
2026-03-28 07:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95807d6a-0a26-5797-8d66-d345c447e371 with identifier: HA17453
2026-03-28 07:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95807d6a-0a26-5797-8d66-d345c447e371 with scrape type 2
2026-03-28 07:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95807d6a-0a26-5797-8d66-d345c447e371 with scrape type 2
2026-03-28 07:38:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95807d6a-0a26-5797-8d66-d345c447e371, identifier: HA17453
2026-03-28 07:38:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95807d6a-0a26-5797-8d66-d345c447e371 with identifier: HA17453
2026-03-28 07:38:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95807d6a-0a26-5797-8d66-d345c447e371 with identifier: HA17453
2026-03-28 07:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95807d6a-0a26-5797-8d66-d345c447e371 with identifier: HA17453 to the API
2026-03-28 07:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 450,
'expiration_date': '2026-03-28T16:48:28Z',
'fuel_type': 'petrol',
'id': '95807d6a-0a26-5797-8d66-d345c447e371',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA17453',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 220604,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-08',
'seller_name': None,
'title': 'BMW X5 xDrive 50i',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-28 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA17453%27 HTTP/1.1" 200 None
2026-03-28 07:38:58 [auto1.de] INFO: Saving data for HA17453: {'auction_closing_time': 1774716508.0, 'created_time': 1773307281.505033, 'last_price_update_time': 1774683538.351206}
2026-03-28 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA17453') HTTP/1.1" 204 0
2026-03-28 07:38:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:38:58 [auto1.de] INFO: Found listing with ID: UE28528
2026-03-28 07:38:58 [auto1.de] INFO: Found listing with ID: PP91103
2026-03-28 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP91103%27 HTTP/1.1" 200 None
2026-03-28 07:38:58 [auto1.de] INFO: Scrape type for PP91103: 0
2026-03-28 07:38:58 [auto1.de] INFO: Found listing with ID: PY54306
2026-03-28 07:38:58 [auto1.de] INFO: Found listing with ID: JH65872
2026-03-28 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH65872%27 HTTP/1.1" 200 None
2026-03-28 07:38:58 [auto1.de] INFO: Scrape type for JH65872: 2
2026-03-28 07:38:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51c47697-373d-58ac-93f1-bff11f943e26 with identifier: JH65872
2026-03-28 07:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51c47697-373d-58ac-93f1-bff11f943e26 with scrape type 2
2026-03-28 07:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51c47697-373d-58ac-93f1-bff11f943e26 with scrape type 2
2026-03-28 07:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 51c47697-373d-58ac-93f1-bff11f943e26, identifier: JH65872
2026-03-28 07:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 51c47697-373d-58ac-93f1-bff11f943e26 with identifier: JH65872
2026-03-28 07:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 51c47697-373d-58ac-93f1-bff11f943e26 with identifier: JH65872
2026-03-28 07:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 51c47697-373d-58ac-93f1-bff11f943e26 with identifier: JH65872 to the API
2026-03-28 07:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:40:03Z',
'fuel_type': 'diesel',
'id': '51c47697-373d-58ac-93f1-bff11f943e26',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH65872',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII Sportsvan',
'odometer': 204533,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-03',
'seller_name': None,
'title': 'Volkswagen Golf VII Sportsvan 1.6 TDI Allstar BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Allstar BlueMotion Tech',
'year': 2016}
2026-03-28 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH65872%27 HTTP/1.1" 200 None
2026-03-28 07:38:58 [auto1.de] INFO: Saving data for JH65872: {'auction_closing_time': 1774716003.0, 'created_time': 1774466754.669347, 'last_price_update_time': 1774683538.903874}
2026-03-28 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH65872') HTTP/1.1" 204 0
2026-03-28 07:38:58 [auto1.de] INFO: Found listing with ID: CT22641
2026-03-28 07:38:58 [auto1.de] INFO: Found listing with ID: LX22574
2026-03-28 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX22574%27 HTTP/1.1" 200 None
2026-03-28 07:38:58 [auto1.de] INFO: Scrape type for LX22574: 0
2026-03-28 07:38:58 [auto1.de] INFO: Found listing with ID: DJ97721
2026-03-28 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ97721%27 HTTP/1.1" 200 None
2026-03-28 07:38:58 [auto1.de] INFO: Scrape type for DJ97721: 0
2026-03-28 07:38:58 [auto1.de] INFO: Found listing with ID: SY63784
2026-03-28 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY63784%27 HTTP/1.1" 200 None
2026-03-28 07:38:58 [auto1.de] INFO: Scrape type for SY63784: 2
2026-03-28 07:38:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f34418f-dc02-59e8-8ee3-7272cda99c15 with identifier: SY63784
2026-03-28 07:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f34418f-dc02-59e8-8ee3-7272cda99c15 with scrape type 2
2026-03-28 07:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f34418f-dc02-59e8-8ee3-7272cda99c15 with scrape type 2
2026-03-28 07:38:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f34418f-dc02-59e8-8ee3-7272cda99c15, identifier: SY63784
2026-03-28 07:38:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f34418f-dc02-59e8-8ee3-7272cda99c15 with identifier: SY63784
2026-03-28 07:38:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f34418f-dc02-59e8-8ee3-7272cda99c15 with identifier: SY63784
2026-03-28 07:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f34418f-dc02-59e8-8ee3-7272cda99c15 with identifier: SY63784 to the API
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:08:25Z',
'fuel_type': 'petrol',
'id': '6f34418f-dc02-59e8-8ee3-7272cda99c15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY63784',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 147144,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-02',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Cup BlueMotion Tech',
'transmission': 'manual',
'trim': 'Cup BlueMotion Tech',
'year': 2014}
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY63784%27 HTTP/1.1" 200 None
2026-03-28 07:38:59 [auto1.de] INFO: Saving data for SY63784: {'auction_closing_time': 1774714105.0, 'created_time': 1774465868.563659, 'last_price_update_time': 1774683539.358606}
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY63784') HTTP/1.1" 204 0
2026-03-28 07:38:59 [auto1.de] INFO: Found listing with ID: EX64798
2026-03-28 07:38:59 [auto1.de] INFO: Found listing with ID: WY14478
2026-03-28 07:38:59 [auto1.de] INFO: Found listing with ID: JR56038
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR56038%27 HTTP/1.1" 200 None
2026-03-28 07:38:59 [auto1.de] INFO: Scrape type for JR56038: 0
2026-03-28 07:38:59 [auto1.de] INFO: Found listing with ID: KP36824
2026-03-28 07:38:59 [auto1.de] INFO: Found listing with ID: XM84350
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM84350%27 HTTP/1.1" 200 None
2026-03-28 07:38:59 [auto1.de] INFO: Scrape type for XM84350: 0
2026-03-28 07:38:59 [auto1.de] INFO: Found listing with ID: FH12952
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH12952%27 HTTP/1.1" 200 None
2026-03-28 07:38:59 [auto1.de] INFO: Scrape type for FH12952: 0
2026-03-28 07:38:59 [auto1.de] INFO: Found listing with ID: RS30445
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS30445%27 HTTP/1.1" 200 None
2026-03-28 07:38:59 [auto1.de] INFO: Scrape type for RS30445: 0
2026-03-28 07:38:59 [auto1.de] INFO: Found listing with ID: GK32978
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK32978%27 HTTP/1.1" 200 None
2026-03-28 07:38:59 [auto1.de] INFO: Scrape type for GK32978: 0
2026-03-28 07:38:59 [auto1.de] INFO: Found listing with ID: DL87338
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL87338%27 HTTP/1.1" 200 None
2026-03-28 07:38:59 [auto1.de] INFO: Scrape type for DL87338: 0
2026-03-28 07:38:59 [auto1.de] INFO: Found listing with ID: KX39833
2026-03-28 07:38:59 [auto1.de] INFO: Found listing with ID: CC31467
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC31467%27 HTTP/1.1" 200 None
2026-03-28 07:38:59 [auto1.de] INFO: Scrape type for CC31467: 2
2026-03-28 07:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19c3e8e6-bc5e-53d9-92dd-164f4a791dbf with identifier: CC31467
2026-03-28 07:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19c3e8e6-bc5e-53d9-92dd-164f4a791dbf with scrape type 2
2026-03-28 07:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19c3e8e6-bc5e-53d9-92dd-164f4a791dbf with scrape type 2
2026-03-28 07:38:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19c3e8e6-bc5e-53d9-92dd-164f4a791dbf, identifier: CC31467
2026-03-28 07:38:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19c3e8e6-bc5e-53d9-92dd-164f4a791dbf with identifier: CC31467
2026-03-28 07:38:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19c3e8e6-bc5e-53d9-92dd-164f4a791dbf with identifier: CC31467
2026-03-28 07:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19c3e8e6-bc5e-53d9-92dd-164f4a791dbf with identifier: CC31467 to the API
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:38:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:44:06Z',
'fuel_type': 'petrol',
'id': '19c3e8e6-bc5e-53d9-92dd-164f4a791dbf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC31467',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 29087,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-10',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2019}
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC31467%27 HTTP/1.1" 200 None
2026-03-28 07:38:59 [auto1.de] INFO: Saving data for CC31467: {'auction_closing_time': 1774716246.0, 'created_time': 1774464704.333496, 'last_price_update_time': 1774683539.916125}
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC31467') HTTP/1.1" 204 0
2026-03-28 07:39:00 [auto1.de] INFO: Found listing with ID: ZM02354
2026-03-28 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM02354%27 HTTP/1.1" 200 None
2026-03-28 07:39:00 [auto1.de] INFO: Scrape type for ZM02354: 2
2026-03-28 07:39:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c5c0ada-9c02-5419-b55b-3c2ee76c12b3 with identifier: ZM02354
2026-03-28 07:39:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c5c0ada-9c02-5419-b55b-3c2ee76c12b3 with scrape type 2
2026-03-28 07:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c5c0ada-9c02-5419-b55b-3c2ee76c12b3 with scrape type 2
2026-03-28 07:39:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c5c0ada-9c02-5419-b55b-3c2ee76c12b3, identifier: ZM02354
2026-03-28 07:39:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c5c0ada-9c02-5419-b55b-3c2ee76c12b3 with identifier: ZM02354
2026-03-28 07:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c5c0ada-9c02-5419-b55b-3c2ee76c12b3 with identifier: ZM02354
2026-03-28 07:39:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c5c0ada-9c02-5419-b55b-3c2ee76c12b3 with identifier: ZM02354 to the API
2026-03-28 07:39:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:43:59Z',
'fuel_type': 'petrol',
'id': '6c5c0ada-9c02-5419-b55b-3c2ee76c12b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM02354',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 74442,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-19',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 T-GDI Mild-Hybrid Select 2WD',
'transmission': 'automatic',
'trim': 'Select 2WD',
'year': 2022}
2026-03-28 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM02354%27 HTTP/1.1" 200 None
2026-03-28 07:39:00 [auto1.de] INFO: Saving data for ZM02354: {'auction_closing_time': 1774716239.0, 'created_time': 1774464418.323667, 'last_price_update_time': 1774683540.489993}
2026-03-28 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM02354') HTTP/1.1" 204 0
2026-03-28 07:39:00 [auto1.de] INFO: Found listing with ID: JA10385
2026-03-28 07:39:00 [auto1.de] INFO: Found listing with ID: DG26223
2026-03-28 07:39:00 [auto1.de] INFO: Found listing with ID: GA19207
2026-03-28 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA19207%27 HTTP/1.1" 200 None
2026-03-28 07:39:00 [auto1.de] INFO: Scrape type for GA19207: 0
2026-03-28 07:39:00 [auto1.de] INFO: Found listing with ID: GY36946
2026-03-28 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY36946%27 HTTP/1.1" 200 None
2026-03-28 07:39:00 [auto1.de] INFO: Scrape type for GY36946: 0
2026-03-28 07:39:00 [auto1.de] INFO: Found listing with ID: GS35122
2026-03-28 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS35122%27 HTTP/1.1" 200 None
2026-03-28 07:39:00 [auto1.de] INFO: Scrape type for GS35122: 0
2026-03-28 07:39:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:39:01 [auto1.de] INFO: Channel: 24h | Page: 110 | totalHits: 9260 | hits on page: 40
2026-03-28 07:39:01 [auto1.de] INFO: Found listing with ID: CM50859
2026-03-28 07:39:01 [auto1.de] INFO: Found listing with ID: UZ18000
2026-03-28 07:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ18000%27 HTTP/1.1" 200 None
2026-03-28 07:39:01 [auto1.de] INFO: Scrape type for UZ18000: 0
2026-03-28 07:39:01 [auto1.de] INFO: Found listing with ID: ZM31431
2026-03-28 07:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM31431%27 HTTP/1.1" 200 None
2026-03-28 07:39:01 [auto1.de] INFO: Scrape type for ZM31431: 2
2026-03-28 07:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f88398ba-c58f-52d2-80d2-f5f89ffbc6ab with identifier: ZM31431
2026-03-28 07:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f88398ba-c58f-52d2-80d2-f5f89ffbc6ab with scrape type 2
2026-03-28 07:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f88398ba-c58f-52d2-80d2-f5f89ffbc6ab with scrape type 2
2026-03-28 07:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f88398ba-c58f-52d2-80d2-f5f89ffbc6ab, identifier: ZM31431
2026-03-28 07:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f88398ba-c58f-52d2-80d2-f5f89ffbc6ab with identifier: ZM31431
2026-03-28 07:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f88398ba-c58f-52d2-80d2-f5f89ffbc6ab with identifier: ZM31431
2026-03-28 07:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f88398ba-c58f-52d2-80d2-f5f89ffbc6ab with identifier: ZM31431 to the API
2026-03-28 07:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-28T16:36:43Z',
'fuel_type': 'diesel',
'id': 'f88398ba-c58f-52d2-80d2-f5f89ffbc6ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM31431',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 217725,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-22',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Cup Sport & Style 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Cup Sport & Style 4Motion BlueMotion',
'year': 2014}
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM31431%27 HTTP/1.1" 200 None
2026-03-28 07:39:02 [auto1.de] INFO: Saving data for ZM31431: {'auction_closing_time': 1774715803.0, 'created_time': 1774466648.34453, 'last_price_update_time': 1774683542.193063}
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM31431') HTTP/1.1" 204 0
2026-03-28 07:39:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: KW13573
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW13573%27 HTTP/1.1" 200 None
2026-03-28 07:39:02 [auto1.de] INFO: Scrape type for KW13573: 0
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: EE01889
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE01889%27 HTTP/1.1" 200 None
2026-03-28 07:39:02 [auto1.de] INFO: Scrape type for EE01889: 0
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: FD10319
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: SK44857
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: ZP35673
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: DK81412
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81412%27 HTTP/1.1" 200 None
2026-03-28 07:39:02 [auto1.de] INFO: Scrape type for DK81412: 0
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: BZ42521
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: FK25443
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK25443%27 HTTP/1.1" 200 None
2026-03-28 07:39:02 [auto1.de] INFO: Scrape type for FK25443: 0
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: FS70562
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS70562%27 HTTP/1.1" 200 None
2026-03-28 07:39:02 [auto1.de] INFO: Scrape type for FS70562: 0
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: UK82813
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: XY75153
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY75153%27 HTTP/1.1" 200 None
2026-03-28 07:39:02 [auto1.de] INFO: Scrape type for XY75153: 0
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: HS46985
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS46985%27 HTTP/1.1" 200 None
2026-03-28 07:39:02 [auto1.de] INFO: Scrape type for HS46985: 0
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: JU05593
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU05593%27 HTTP/1.1" 200 None
2026-03-28 07:39:02 [auto1.de] INFO: Scrape type for JU05593: 0
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: UA30528
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: LN75717
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: CA34591
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA34591%27 HTTP/1.1" 200 None
2026-03-28 07:39:02 [auto1.de] INFO: Scrape type for CA34591: 0
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: ZN40502
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: ZT31160
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: SD17030
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD17030%27 HTTP/1.1" 200 None
2026-03-28 07:39:02 [auto1.de] INFO: Scrape type for SD17030: 0
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: VS80969
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS80969%27 HTTP/1.1" 200 None
2026-03-28 07:39:02 [auto1.de] INFO: Scrape type for VS80969: 0
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: JJ00405
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ00405%27 HTTP/1.1" 200 None
2026-03-28 07:39:02 [auto1.de] INFO: Scrape type for JJ00405: 0
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: TY80313
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: RP79325
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP79325%27 HTTP/1.1" 200 None
2026-03-28 07:39:02 [auto1.de] INFO: Scrape type for RP79325: 0
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: KG01306
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG01306%27 HTTP/1.1" 200 None
2026-03-28 07:39:02 [auto1.de] INFO: Scrape type for KG01306: 0
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: MU08811
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU08811%27 HTTP/1.1" 200 None
2026-03-28 07:39:02 [auto1.de] INFO: Scrape type for MU08811: 0
2026-03-28 07:39:02 [auto1.de] INFO: Found listing with ID: BH79030
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH79030%27 HTTP/1.1" 200 None
2026-03-28 07:39:02 [auto1.de] INFO: Scrape type for BH79030: 2
2026-03-28 07:39:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25e0064f-5a66-59d1-b9be-4be7d371f9bf with identifier: BH79030
2026-03-28 07:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25e0064f-5a66-59d1-b9be-4be7d371f9bf with scrape type 2
2026-03-28 07:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25e0064f-5a66-59d1-b9be-4be7d371f9bf with scrape type 2
2026-03-28 07:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25e0064f-5a66-59d1-b9be-4be7d371f9bf, identifier: BH79030
2026-03-28 07:39:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25e0064f-5a66-59d1-b9be-4be7d371f9bf with identifier: BH79030
2026-03-28 07:39:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25e0064f-5a66-59d1-b9be-4be7d371f9bf with identifier: BH79030
2026-03-28 07:39:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25e0064f-5a66-59d1-b9be-4be7d371f9bf with identifier: BH79030 to the API
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:43:15Z',
'fuel_type': 'diesel',
'id': '25e0064f-5a66-59d1-b9be-4be7d371f9bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH79030',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 11916,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-29',
'seller_name': None,
'title': 'Volkswagen T-Roc 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2023}
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH79030%27 HTTP/1.1" 200 None
2026-03-28 07:39:02 [auto1.de] INFO: Saving data for BH79030: {'auction_closing_time': 1774716195.0, 'created_time': 1774467421.353343, 'last_price_update_time': 1774683542.89805}
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH79030') HTTP/1.1" 204 0
2026-03-28 07:39:03 [auto1.de] INFO: Found listing with ID: JU32018
2026-03-28 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU32018%27 HTTP/1.1" 200 None
2026-03-28 07:39:03 [auto1.de] INFO: Scrape type for JU32018: 0
2026-03-28 07:39:03 [auto1.de] INFO: Found listing with ID: JT99615
2026-03-28 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT99615%27 HTTP/1.1" 200 None
2026-03-28 07:39:03 [auto1.de] INFO: Scrape type for JT99615: 0
2026-03-28 07:39:03 [auto1.de] INFO: Found listing with ID: BB60777
2026-03-28 07:39:03 [auto1.de] INFO: Found listing with ID: JP78451
2026-03-28 07:39:03 [auto1.de] INFO: Found listing with ID: AG20717
2026-03-28 07:39:03 [auto1.de] INFO: Found listing with ID: GW98108
2026-03-28 07:39:03 [auto1.de] INFO: Found listing with ID: CH88206
2026-03-28 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH88206%27 HTTP/1.1" 200 None
2026-03-28 07:39:03 [auto1.de] INFO: Scrape type for CH88206: 0
2026-03-28 07:39:03 [auto1.de] INFO: Found listing with ID: KP40091
2026-03-28 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP40091%27 HTTP/1.1" 200 None
2026-03-28 07:39:03 [auto1.de] INFO: Scrape type for KP40091: 0
2026-03-28 07:39:03 [auto1.de] INFO: Found listing with ID: SX62483
2026-03-28 07:39:03 [auto1.de] INFO: Found listing with ID: FT64336
2026-03-28 07:39:03 [auto1.de] INFO: Found listing with ID: UW75870
2026-03-28 07:39:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:39:03 [auto1.de] INFO: Channel: 24h | Page: 111 | totalHits: 9260 | hits on page: 40
2026-03-28 07:39:03 [auto1.de] INFO: Found listing with ID: NC84547
2026-03-28 07:39:03 [auto1.de] INFO: Found listing with ID: UR62816
2026-03-28 07:39:03 [auto1.de] INFO: Found listing with ID: LC00644
2026-03-28 07:39:03 [auto1.de] INFO: Found listing with ID: SX42326
2026-03-28 07:39:03 [auto1.de] INFO: Found listing with ID: JB63291
2026-03-28 07:39:03 [auto1.de] INFO: Found listing with ID: BE29986
2026-03-28 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE29986%27 HTTP/1.1" 200 None
2026-03-28 07:39:03 [auto1.de] INFO: Scrape type for BE29986: 2
2026-03-28 07:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97f8e425-eda8-57e4-a40e-78452632369c with identifier: BE29986
2026-03-28 07:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97f8e425-eda8-57e4-a40e-78452632369c with scrape type 2
2026-03-28 07:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97f8e425-eda8-57e4-a40e-78452632369c with scrape type 2
2026-03-28 07:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97f8e425-eda8-57e4-a40e-78452632369c, identifier: BE29986
2026-03-28 07:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97f8e425-eda8-57e4-a40e-78452632369c with identifier: BE29986
2026-03-28 07:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97f8e425-eda8-57e4-a40e-78452632369c with identifier: BE29986
2026-03-28 07:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97f8e425-eda8-57e4-a40e-78452632369c with identifier: BE29986 to the API
2026-03-28 07:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:44:41Z',
'fuel_type': 'petrol',
'id': '97f8e425-eda8-57e4-a40e-78452632369c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE29986',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 112939,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-31',
'seller_name': None,
'title': 'Peugeot 207 1.4 VTi Urban Move',
'transmission': 'manual',
'trim': 'Urban Move',
'year': 2011}
2026-03-28 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE29986%27 HTTP/1.1" 200 None
2026-03-28 07:39:04 [auto1.de] INFO: Saving data for BE29986: {'auction_closing_time': 1774716281.0, 'created_time': 1774467191.626375, 'last_price_update_time': 1774683544.339808}
2026-03-28 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE29986') HTTP/1.1" 204 0
2026-03-28 07:39:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:39:04 [auto1.de] INFO: Found listing with ID: VY10648
2026-03-28 07:39:04 [auto1.de] INFO: Found listing with ID: XR74072
2026-03-28 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR74072%27 HTTP/1.1" 200 None
2026-03-28 07:39:04 [auto1.de] INFO: Scrape type for XR74072: 2
2026-03-28 07:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90000786-ff54-5003-9562-f8ca4daaf791 with identifier: XR74072
2026-03-28 07:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90000786-ff54-5003-9562-f8ca4daaf791 with scrape type 2
2026-03-28 07:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90000786-ff54-5003-9562-f8ca4daaf791 with scrape type 2
2026-03-28 07:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90000786-ff54-5003-9562-f8ca4daaf791, identifier: XR74072
2026-03-28 07:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90000786-ff54-5003-9562-f8ca4daaf791 with identifier: XR74072
2026-03-28 07:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90000786-ff54-5003-9562-f8ca4daaf791 with identifier: XR74072
2026-03-28 07:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90000786-ff54-5003-9562-f8ca4daaf791 with identifier: XR74072 to the API
2026-03-28 07:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:52:01Z',
'fuel_type': 'petrol',
'id': '90000786-ff54-5003-9562-f8ca4daaf791',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR74072',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 193477,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-08',
'seller_name': None,
'title': 'Skoda Fabia 1.6 Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2009}
2026-03-28 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR74072%27 HTTP/1.1" 200 None
2026-03-28 07:39:04 [auto1.de] INFO: Saving data for XR74072: {'auction_closing_time': 1774716721.0, 'created_time': 1773400675.632472, 'last_price_update_time': 1774683544.890766}
2026-03-28 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR74072') HTTP/1.1" 204 0
2026-03-28 07:39:04 [auto1.de] INFO: Found listing with ID: ZL38204
2026-03-28 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL38204%27 HTTP/1.1" 200 None
2026-03-28 07:39:04 [auto1.de] INFO: Scrape type for ZL38204: 0
2026-03-28 07:39:04 [auto1.de] INFO: Found listing with ID: UE64486
2026-03-28 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE64486%27 HTTP/1.1" 200 None
2026-03-28 07:39:04 [auto1.de] INFO: Scrape type for UE64486: 0
2026-03-28 07:39:04 [auto1.de] INFO: Found listing with ID: WW56601
2026-03-28 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW56601%27 HTTP/1.1" 200 None
2026-03-28 07:39:04 [auto1.de] INFO: Scrape type for WW56601: 0
2026-03-28 07:39:04 [auto1.de] INFO: Found listing with ID: HP87000
2026-03-28 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP87000%27 HTTP/1.1" 200 None
2026-03-28 07:39:04 [auto1.de] INFO: Scrape type for HP87000: 0
2026-03-28 07:39:04 [auto1.de] INFO: Found listing with ID: LD01626
2026-03-28 07:39:04 [auto1.de] INFO: Found listing with ID: NM87111
2026-03-28 07:39:04 [auto1.de] INFO: Found listing with ID: HX36326
2026-03-28 07:39:04 [auto1.de] INFO: Found listing with ID: YV66765
2026-03-28 07:39:04 [auto1.de] INFO: Found listing with ID: UP64202
2026-03-28 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP64202%27 HTTP/1.1" 200 None
2026-03-28 07:39:04 [auto1.de] INFO: Scrape type for UP64202: 0
2026-03-28 07:39:04 [auto1.de] INFO: Found listing with ID: ZA74026
2026-03-28 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74026%27 HTTP/1.1" 200 None
2026-03-28 07:39:05 [auto1.de] INFO: Scrape type for ZA74026: 0
2026-03-28 07:39:05 [auto1.de] INFO: Found listing with ID: RN84486
2026-03-28 07:39:05 [auto1.de] INFO: Found listing with ID: UC78818
2026-03-28 07:39:05 [auto1.de] INFO: Found listing with ID: VA46995
2026-03-28 07:39:05 [auto1.de] INFO: Found listing with ID: TP67168
2026-03-28 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP67168%27 HTTP/1.1" 200 None
2026-03-28 07:39:05 [auto1.de] INFO: Scrape type for TP67168: 0
2026-03-28 07:39:05 [auto1.de] INFO: Found listing with ID: FR76409
2026-03-28 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR76409%27 HTTP/1.1" 200 None
2026-03-28 07:39:05 [auto1.de] INFO: Scrape type for FR76409: 0
2026-03-28 07:39:05 [auto1.de] INFO: Found listing with ID: EW53480
2026-03-28 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW53480%27 HTTP/1.1" 200 None
2026-03-28 07:39:05 [auto1.de] INFO: Scrape type for EW53480: 0
2026-03-28 07:39:05 [auto1.de] INFO: Found listing with ID: KN86570
2026-03-28 07:39:05 [auto1.de] INFO: Found listing with ID: SZ10404
2026-03-28 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ10404%27 HTTP/1.1" 200 None
2026-03-28 07:39:05 [auto1.de] INFO: Scrape type for SZ10404: 0
2026-03-28 07:39:05 [auto1.de] INFO: Found listing with ID: YB59373
2026-03-28 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB59373%27 HTTP/1.1" 200 None
2026-03-28 07:39:05 [auto1.de] INFO: Scrape type for YB59373: 0
2026-03-28 07:39:05 [auto1.de] INFO: Found listing with ID: BT97276
2026-03-28 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT97276%27 HTTP/1.1" 200 None
2026-03-28 07:39:05 [auto1.de] INFO: Scrape type for BT97276: 0
2026-03-28 07:39:05 [auto1.de] INFO: Found listing with ID: LL77007
2026-03-28 07:39:05 [auto1.de] INFO: Found listing with ID: CH65115
2026-03-28 07:39:05 [auto1.de] INFO: Found listing with ID: FW15462
2026-03-28 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW15462%27 HTTP/1.1" 200 None
2026-03-28 07:39:05 [auto1.de] INFO: Scrape type for FW15462: 0
2026-03-28 07:39:05 [auto1.de] INFO: Found listing with ID: XV72544
2026-03-28 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV72544%27 HTTP/1.1" 200 None
2026-03-28 07:39:05 [auto1.de] INFO: Scrape type for XV72544: 0
2026-03-28 07:39:05 [auto1.de] INFO: Found listing with ID: CY78505
2026-03-28 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY78505%27 HTTP/1.1" 200 None
2026-03-28 07:39:05 [auto1.de] INFO: Scrape type for CY78505: 0
2026-03-28 07:39:05 [auto1.de] INFO: Found listing with ID: SB50693
2026-03-28 07:39:05 [auto1.de] INFO: Found listing with ID: PL37483
2026-03-28 07:39:05 [auto1.de] INFO: Found listing with ID: KR09634
2026-03-28 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR09634%27 HTTP/1.1" 200 None
2026-03-28 07:39:05 [auto1.de] INFO: Scrape type for KR09634: 0
2026-03-28 07:39:05 [auto1.de] INFO: Found listing with ID: XD09814
2026-03-28 07:39:05 [auto1.de] INFO: Found listing with ID: BF67305
2026-03-28 07:39:05 [auto1.de] INFO: Found listing with ID: AD64899
2026-03-28 07:39:05 [auto1.de] INFO: Found listing with ID: LK57603
2026-03-28 07:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:39:06 [auto1.de] INFO: Channel: 24h | Page: 112 | totalHits: 9260 | hits on page: 40
2026-03-28 07:39:06 [auto1.de] INFO: Found listing with ID: CV84531
2026-03-28 07:39:06 [auto1.de] INFO: Found listing with ID: ZH99212
2026-03-28 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH99212%27 HTTP/1.1" 200 None
2026-03-28 07:39:06 [auto1.de] INFO: Scrape type for ZH99212: 2
2026-03-28 07:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fa77f50-95ed-5a18-9d18-97f37b6fa419 with identifier: ZH99212
2026-03-28 07:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fa77f50-95ed-5a18-9d18-97f37b6fa419 with scrape type 2
2026-03-28 07:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fa77f50-95ed-5a18-9d18-97f37b6fa419 with scrape type 2
2026-03-28 07:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9fa77f50-95ed-5a18-9d18-97f37b6fa419, identifier: ZH99212
2026-03-28 07:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9fa77f50-95ed-5a18-9d18-97f37b6fa419 with identifier: ZH99212
2026-03-28 07:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9fa77f50-95ed-5a18-9d18-97f37b6fa419 with identifier: ZH99212
2026-03-28 07:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9fa77f50-95ed-5a18-9d18-97f37b6fa419 with identifier: ZH99212 to the API
2026-03-28 07:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:27:57Z',
'fuel_type': 'petrol',
'id': '9fa77f50-95ed-5a18-9d18-97f37b6fa419',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH99212',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 177847,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-29',
'seller_name': None,
'title': 'Fiat Panda 1.2 MyLive',
'transmission': 'manual',
'trim': 'MyLive',
'year': 2011}
2026-03-28 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH99212%27 HTTP/1.1" 200 None
2026-03-28 07:39:06 [auto1.de] INFO: Saving data for ZH99212: {'auction_closing_time': 1774715277.0, 'created_time': 1774466345.912533, 'last_price_update_time': 1774683546.543626}
2026-03-28 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH99212') HTTP/1.1" 204 0
2026-03-28 07:39:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:39:06 [auto1.de] INFO: Found listing with ID: PK80050
2026-03-28 07:39:06 [auto1.de] INFO: Found listing with ID: KR99013
2026-03-28 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR99013%27 HTTP/1.1" 200 None
2026-03-28 07:39:06 [auto1.de] INFO: Scrape type for KR99013: 0
2026-03-28 07:39:06 [auto1.de] INFO: Found listing with ID: JE50334
2026-03-28 07:39:06 [auto1.de] INFO: Found listing with ID: UN95806
2026-03-28 07:39:06 [auto1.de] INFO: Found listing with ID: ZB59934
2026-03-28 07:39:06 [auto1.de] INFO: Found listing with ID: GU98415
2026-03-28 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU98415%27 HTTP/1.1" 200 None
2026-03-28 07:39:06 [auto1.de] INFO: Scrape type for GU98415: 2
2026-03-28 07:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07eb6ce0-c53e-5176-88c6-21bcb070d24c with identifier: GU98415
2026-03-28 07:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07eb6ce0-c53e-5176-88c6-21bcb070d24c with scrape type 2
2026-03-28 07:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07eb6ce0-c53e-5176-88c6-21bcb070d24c with scrape type 2
2026-03-28 07:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07eb6ce0-c53e-5176-88c6-21bcb070d24c, identifier: GU98415
2026-03-28 07:39:06 [scrapy.extensions.logstats] INFO: Crawled 118 pages (at 17 pages/min), scraped 430 items (at 45 items/min)
2026-03-28 07:39:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 165MiB
2026-03-28 07:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07eb6ce0-c53e-5176-88c6-21bcb070d24c with identifier: GU98415
2026-03-28 07:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07eb6ce0-c53e-5176-88c6-21bcb070d24c with identifier: GU98415
2026-03-28 07:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07eb6ce0-c53e-5176-88c6-21bcb070d24c with identifier: GU98415 to the API
2026-03-28 07:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:26:03Z',
'fuel_type': 'petrol',
'id': '07eb6ce0-c53e-5176-88c6-21bcb070d24c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU98415',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 100078,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-10',
'seller_name': None,
'title': 'Nissan Qashqai 1.3 DIG-T Zama',
'transmission': 'manual',
'trim': 'Zama',
'year': 2021}
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU98415%27 HTTP/1.1" 200 None
2026-03-28 07:39:07 [auto1.de] INFO: Saving data for GU98415: {'auction_closing_time': 1774715163.0, 'created_time': 1774468110.223071, 'last_price_update_time': 1774683547.067587}
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU98415') HTTP/1.1" 204 0
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: GJ43799
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: XV29391
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: AF84640
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF84640%27 HTTP/1.1" 200 None
2026-03-28 07:39:07 [auto1.de] INFO: Scrape type for AF84640: 0
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: MS26334
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS26334%27 HTTP/1.1" 200 None
2026-03-28 07:39:07 [auto1.de] INFO: Scrape type for MS26334: 0
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: SC29196
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: LP17470
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP17470%27 HTTP/1.1" 200 None
2026-03-28 07:39:07 [auto1.de] INFO: Scrape type for LP17470: 0
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: XJ94036
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: PN52671
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: UM69189
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM69189%27 HTTP/1.1" 200 None
2026-03-28 07:39:07 [auto1.de] INFO: Scrape type for UM69189: 0
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: LU22691
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU22691%27 HTTP/1.1" 200 None
2026-03-28 07:39:07 [auto1.de] INFO: Scrape type for LU22691: 0
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: TB42941
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: XE74160
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE74160%27 HTTP/1.1" 200 None
2026-03-28 07:39:07 [auto1.de] INFO: Scrape type for XE74160: 0
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: DP90714
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: AX54291
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: GY49475
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: JL28573
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: UA36533
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA36533%27 HTTP/1.1" 200 None
2026-03-28 07:39:07 [auto1.de] INFO: Scrape type for UA36533: 0
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: EA67695
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA67695%27 HTTP/1.1" 200 None
2026-03-28 07:39:07 [auto1.de] INFO: Scrape type for EA67695: 0
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: NN77195
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: CK75631
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: VJ59637
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ59637%27 HTTP/1.1" 200 None
2026-03-28 07:39:07 [auto1.de] INFO: Scrape type for VJ59637: 0
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: ZR47880
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: DX70553
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX70553%27 HTTP/1.1" 200 None
2026-03-28 07:39:07 [auto1.de] INFO: Scrape type for DX70553: 0
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: PT89540
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: EU24195
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU24195%27 HTTP/1.1" 200 None
2026-03-28 07:39:07 [auto1.de] INFO: Scrape type for EU24195: 0
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: AT83868
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT83868%27 HTTP/1.1" 200 None
2026-03-28 07:39:07 [auto1.de] INFO: Scrape type for AT83868: 0
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: CY41602
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: KF01282
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: EA51834
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: SH57495
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH57495%27 HTTP/1.1" 200 None
2026-03-28 07:39:07 [auto1.de] INFO: Scrape type for SH57495: 0
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: HX02053
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX02053%27 HTTP/1.1" 200 None
2026-03-28 07:39:07 [auto1.de] INFO: Scrape type for HX02053: 2
2026-03-28 07:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b262a22-094d-5b61-a899-d7fd5364af5a with identifier: HX02053
2026-03-28 07:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b262a22-094d-5b61-a899-d7fd5364af5a with scrape type 2
2026-03-28 07:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b262a22-094d-5b61-a899-d7fd5364af5a with scrape type 2
2026-03-28 07:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b262a22-094d-5b61-a899-d7fd5364af5a, identifier: HX02053
2026-03-28 07:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b262a22-094d-5b61-a899-d7fd5364af5a with identifier: HX02053
2026-03-28 07:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b262a22-094d-5b61-a899-d7fd5364af5a with identifier: HX02053
2026-03-28 07:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b262a22-094d-5b61-a899-d7fd5364af5a with identifier: HX02053 to the API
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 292,
'expiration_date': '2026-03-28T16:15:29Z',
'fuel_type': 'petrol',
'id': '1b262a22-094d-5b61-a899-d7fd5364af5a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX02053',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 120855,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-02',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 350 CGI BlueEfficiency Elegance',
'transmission': 'automatic',
'trim': 'BlueEfficiency Elegance',
'year': 2009}
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX02053%27 HTTP/1.1" 200 None
2026-03-28 07:39:07 [auto1.de] INFO: Saving data for HX02053: {'auction_closing_time': 1774714529.0, 'created_time': 1774466108.930688, 'last_price_update_time': 1774683547.717705}
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX02053') HTTP/1.1" 204 0
2026-03-28 07:39:07 [auto1.de] INFO: Found listing with ID: HJ19382
2026-03-28 07:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:39:08 [auto1.de] INFO: Channel: 24h | Page: 113 | totalHits: 9260 | hits on page: 40
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: GK12376
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: FC40686
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC40686%27 HTTP/1.1" 200 None
2026-03-28 07:39:08 [auto1.de] INFO: Scrape type for FC40686: 0
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: BV92050
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV92050%27 HTTP/1.1" 200 None
2026-03-28 07:39:08 [auto1.de] INFO: Scrape type for BV92050: 0
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: DE15792
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE15792%27 HTTP/1.1" 200 None
2026-03-28 07:39:08 [auto1.de] INFO: Scrape type for DE15792: 0
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: RZ14311
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: YP19468
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP19468%27 HTTP/1.1" 200 None
2026-03-28 07:39:08 [auto1.de] INFO: Scrape type for YP19468: 0
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: FG48186
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG48186%27 HTTP/1.1" 200 None
2026-03-28 07:39:08 [auto1.de] INFO: Scrape type for FG48186: 0
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: YC07614
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC07614%27 HTTP/1.1" 200 None
2026-03-28 07:39:08 [auto1.de] INFO: Scrape type for YC07614: 0
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: VW16070
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: EG70840
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG70840%27 HTTP/1.1" 200 None
2026-03-28 07:39:08 [auto1.de] INFO: Scrape type for EG70840: 0
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: TW42181
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW42181%27 HTTP/1.1" 200 None
2026-03-28 07:39:08 [auto1.de] INFO: Scrape type for TW42181: 0
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: HZ36583
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: HU95530
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU95530%27 HTTP/1.1" 200 None
2026-03-28 07:39:08 [auto1.de] INFO: Scrape type for HU95530: 0
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: DB47248
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: HL77152
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: PY00065
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: DD95746
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD95746%27 HTTP/1.1" 200 None
2026-03-28 07:39:08 [auto1.de] INFO: Scrape type for DD95746: 0
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: FT13435
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT13435%27 HTTP/1.1" 200 None
2026-03-28 07:39:08 [auto1.de] INFO: Scrape type for FT13435: 0
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: TM90896
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: KL26301
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL26301%27 HTTP/1.1" 200 None
2026-03-28 07:39:08 [auto1.de] INFO: Scrape type for KL26301: 0
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: VL50005
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: KH87635
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: BG27909
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: KR15967
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: FL13933
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL13933%27 HTTP/1.1" 200 None
2026-03-28 07:39:08 [auto1.de] INFO: Scrape type for FL13933: 0
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: ZU43350
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: UG79449
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG79449%27 HTTP/1.1" 200 None
2026-03-28 07:39:08 [auto1.de] INFO: Scrape type for UG79449: 0
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: EX05236
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: MF18301
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF18301%27 HTTP/1.1" 200 None
2026-03-28 07:39:08 [auto1.de] INFO: Scrape type for MF18301: 0
2026-03-28 07:39:08 [auto1.de] INFO: Found listing with ID: EY99757
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY99757%27 HTTP/1.1" 200 None
2026-03-28 07:39:08 [auto1.de] INFO: Scrape type for EY99757: 2
2026-03-28 07:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8187e34a-08b2-58e8-81cc-a794e9caba1e with identifier: EY99757
2026-03-28 07:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8187e34a-08b2-58e8-81cc-a794e9caba1e with scrape type 2
2026-03-28 07:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8187e34a-08b2-58e8-81cc-a794e9caba1e with scrape type 2
2026-03-28 07:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8187e34a-08b2-58e8-81cc-a794e9caba1e, identifier: EY99757
2026-03-28 07:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8187e34a-08b2-58e8-81cc-a794e9caba1e with identifier: EY99757
2026-03-28 07:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8187e34a-08b2-58e8-81cc-a794e9caba1e with identifier: EY99757
2026-03-28 07:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8187e34a-08b2-58e8-81cc-a794e9caba1e with identifier: EY99757 to the API
2026-03-28 07:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:35:33Z',
'fuel_type': 'petrol',
'id': '8187e34a-08b2-58e8-81cc-a794e9caba1e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY99757',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 90298,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-24',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Highline BlueMotion Tech',
'year': 2014}
2026-03-28 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY99757%27 HTTP/1.1" 200 None
2026-03-28 07:39:09 [auto1.de] INFO: Saving data for EY99757: {'auction_closing_time': 1774715733.0, 'created_time': 1774466308.305469, 'last_price_update_time': 1774683549.390423}
2026-03-28 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY99757') HTTP/1.1" 204 0
2026-03-28 07:39:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:39:09 [auto1.de] INFO: Found listing with ID: KJ94433
2026-03-28 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ94433%27 HTTP/1.1" 200 None
2026-03-28 07:39:09 [auto1.de] INFO: Scrape type for KJ94433: 0
2026-03-28 07:39:09 [auto1.de] INFO: Found listing with ID: SY52709
2026-03-28 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY52709%27 HTTP/1.1" 200 None
2026-03-28 07:39:09 [auto1.de] INFO: Scrape type for SY52709: 2
2026-03-28 07:39:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bda4c882-4907-5e14-91b6-55b8011afcdb with identifier: SY52709
2026-03-28 07:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bda4c882-4907-5e14-91b6-55b8011afcdb with scrape type 2
2026-03-28 07:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bda4c882-4907-5e14-91b6-55b8011afcdb with scrape type 2
2026-03-28 07:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bda4c882-4907-5e14-91b6-55b8011afcdb, identifier: SY52709
2026-03-28 07:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bda4c882-4907-5e14-91b6-55b8011afcdb with identifier: SY52709
2026-03-28 07:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bda4c882-4907-5e14-91b6-55b8011afcdb with identifier: SY52709
2026-03-28 07:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bda4c882-4907-5e14-91b6-55b8011afcdb with identifier: SY52709 to the API
2026-03-28 07:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 136,
'expiration_date': '2026-03-28T16:41:55Z',
'fuel_type': 'diesel',
'id': 'bda4c882-4907-5e14-91b6-55b8011afcdb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY52709',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vito Tourer',
'odometer': 102211,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-05',
'seller_name': None,
'title': 'Mercedes-Benz Vito Tourer 114 CDI Pro 4x4 lang',
'transmission': 'automatic',
'trim': 'Pro 4x4 lang',
'year': 2020}
2026-03-28 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY52709%27 HTTP/1.1" 200 None
2026-03-28 07:39:09 [auto1.de] INFO: Saving data for SY52709: {'auction_closing_time': 1774716115.0, 'created_time': 1774464732.563872, 'last_price_update_time': 1774683549.930589}
2026-03-28 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY52709') HTTP/1.1" 204 0
2026-03-28 07:39:09 [auto1.de] INFO: Found listing with ID: GC15327
2026-03-28 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC15327%27 HTTP/1.1" 200 None
2026-03-28 07:39:09 [auto1.de] INFO: Scrape type for GC15327: 0
2026-03-28 07:39:09 [auto1.de] INFO: Found listing with ID: PC96089
2026-03-28 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC96089%27 HTTP/1.1" 200 None
2026-03-28 07:39:09 [auto1.de] INFO: Scrape type for PC96089: 0
2026-03-28 07:39:09 [auto1.de] INFO: Found listing with ID: ZS29776
2026-03-28 07:39:09 [auto1.de] INFO: Found listing with ID: GW32993
2026-03-28 07:39:09 [auto1.de] INFO: Found listing with ID: ZE91614
2026-03-28 07:39:09 [auto1.de] INFO: Found listing with ID: MD38661
2026-03-28 07:39:09 [auto1.de] INFO: Found listing with ID: LW74577
2026-03-28 07:39:09 [auto1.de] INFO: Found listing with ID: BE10482
2026-03-28 07:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:39:10 [auto1.de] INFO: Channel: 24h | Page: 114 | totalHits: 9260 | hits on page: 40
2026-03-28 07:39:10 [auto1.de] INFO: Found listing with ID: VK94352
2026-03-28 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK94352%27 HTTP/1.1" 200 None
2026-03-28 07:39:10 [auto1.de] INFO: Scrape type for VK94352: 0
2026-03-28 07:39:10 [auto1.de] INFO: Found listing with ID: DA94168
2026-03-28 07:39:10 [auto1.de] INFO: Found listing with ID: KV18345
2026-03-28 07:39:10 [auto1.de] INFO: Found listing with ID: NW56335
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW56335%27 HTTP/1.1" 200 None
2026-03-28 07:39:11 [auto1.de] INFO: Scrape type for NW56335: 0
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: CS67228
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: XX23158
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: MM36361
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM36361%27 HTTP/1.1" 200 None
2026-03-28 07:39:11 [auto1.de] INFO: Scrape type for MM36361: 0
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: AP69664
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: LL59024
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: CZ73212
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ73212%27 HTTP/1.1" 200 None
2026-03-28 07:39:11 [auto1.de] INFO: Scrape type for CZ73212: 0
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: EV67878
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV67878%27 HTTP/1.1" 200 None
2026-03-28 07:39:11 [auto1.de] INFO: Scrape type for EV67878: 0
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: TZ11746
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ11746%27 HTTP/1.1" 200 None
2026-03-28 07:39:11 [auto1.de] INFO: Scrape type for TZ11746: 0
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: SP13304
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP13304%27 HTTP/1.1" 200 None
2026-03-28 07:39:11 [auto1.de] INFO: Scrape type for SP13304: 0
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: CX40237
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX40237%27 HTTP/1.1" 200 None
2026-03-28 07:39:11 [auto1.de] INFO: Scrape type for CX40237: 0
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: CK60135
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK60135%27 HTTP/1.1" 200 None
2026-03-28 07:39:11 [auto1.de] INFO: Scrape type for CK60135: 0
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: XS27718
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: KT50615
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT50615%27 HTTP/1.1" 200 None
2026-03-28 07:39:11 [auto1.de] INFO: Scrape type for KT50615: 0
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: KY70270
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: VD25373
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: LE60252
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE60252%27 HTTP/1.1" 200 None
2026-03-28 07:39:11 [auto1.de] INFO: Scrape type for LE60252: 0
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: ZU35260
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU35260%27 HTTP/1.1" 200 None
2026-03-28 07:39:11 [auto1.de] INFO: Scrape type for ZU35260: 0
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: CR67511
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: RT10387
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: TF12551
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF12551%27 HTTP/1.1" 200 None
2026-03-28 07:39:11 [auto1.de] INFO: Scrape type for TF12551: 0
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: NA95375
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA95375%27 HTTP/1.1" 200 None
2026-03-28 07:39:11 [auto1.de] INFO: Scrape type for NA95375: 0
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: HV21869
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV21869%27 HTTP/1.1" 200 None
2026-03-28 07:39:11 [auto1.de] INFO: Scrape type for HV21869: 0
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: CY33592
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY33592%27 HTTP/1.1" 200 None
2026-03-28 07:39:11 [auto1.de] INFO: Scrape type for CY33592: 0
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: HF35656
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: LJ58074
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: FU70567
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU70567%27 HTTP/1.1" 200 None
2026-03-28 07:39:11 [auto1.de] INFO: Scrape type for FU70567: 0
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: ZF79650
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF79650%27 HTTP/1.1" 200 None
2026-03-28 07:39:11 [auto1.de] INFO: Scrape type for ZF79650: 0
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: RX78889
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: FG50189
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG50189%27 HTTP/1.1" 200 None
2026-03-28 07:39:11 [auto1.de] INFO: Scrape type for FG50189: 0
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: YY18465
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: RA78002
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: AX13429
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX13429%27 HTTP/1.1" 200 None
2026-03-28 07:39:11 [auto1.de] INFO: Scrape type for AX13429: 0
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: DK74587
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: UT06922
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT06922%27 HTTP/1.1" 200 None
2026-03-28 07:39:11 [auto1.de] INFO: Scrape type for UT06922: 0
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: EW76820
2026-03-28 07:39:11 [auto1.de] INFO: Found listing with ID: NY29547
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY29547%27 HTTP/1.1" 200 None
2026-03-28 07:39:11 [auto1.de] INFO: Scrape type for NY29547: 0
2026-03-28 07:39:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:39:12 [auto1.de] INFO: Channel: 24h | Page: 115 | totalHits: 9260 | hits on page: 40
2026-03-28 07:39:12 [auto1.de] INFO: Found listing with ID: AS57198
2026-03-28 07:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS57198%27 HTTP/1.1" 200 None
2026-03-28 07:39:12 [auto1.de] INFO: Scrape type for AS57198: 0
2026-03-28 07:39:12 [auto1.de] INFO: Found listing with ID: AK11207
2026-03-28 07:39:12 [auto1.de] INFO: Found listing with ID: WM78978
2026-03-28 07:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM78978%27 HTTP/1.1" 200 None
2026-03-28 07:39:12 [auto1.de] INFO: Scrape type for WM78978: 2
2026-03-28 07:39:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c02bb2d4-5c36-51a6-9807-14f72fa22fa9 with identifier: WM78978
2026-03-28 07:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c02bb2d4-5c36-51a6-9807-14f72fa22fa9 with scrape type 2
2026-03-28 07:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c02bb2d4-5c36-51a6-9807-14f72fa22fa9 with scrape type 2
2026-03-28 07:39:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c02bb2d4-5c36-51a6-9807-14f72fa22fa9, identifier: WM78978
2026-03-28 07:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c02bb2d4-5c36-51a6-9807-14f72fa22fa9 with identifier: WM78978
2026-03-28 07:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:39:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-28 07:39:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c02bb2d4-5c36-51a6-9807-14f72fa22fa9 with identifier: WM78978
2026-03-28 07:39:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c02bb2d4-5c36-51a6-9807-14f72fa22fa9 with identifier: WM78978 to the API
2026-03-28 07:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 82,
'expiration_date': '2026-03-28T16:56:58Z',
'fuel_type': 'electro',
'id': 'c02bb2d4-5c36-51a6-9807-14f72fa22fa9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM78978',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 27029,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-10',
'seller_name': None,
'title': 'Smart fortwo electric drive 60 kW Prime',
'transmission': 'automatic',
'trim': 'Prime',
'year': 2018}
2026-03-28 07:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM78978%27 HTTP/1.1" 200 None
2026-03-28 07:39:13 [auto1.de] INFO: Saving data for WM78978: {'auction_closing_time': 1774717018.0, 'created_time': 1774468028.768127, 'last_price_update_time': 1774683553.480134}
2026-03-28 07:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM78978') HTTP/1.1" 204 0
2026-03-28 07:39:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:39:13 [auto1.de] INFO: Found listing with ID: GV09290
2026-03-28 07:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV09290%27 HTTP/1.1" 200 None
2026-03-28 07:39:13 [auto1.de] INFO: Scrape type for GV09290: 0
2026-03-28 07:39:13 [auto1.de] INFO: Found listing with ID: AV68122
2026-03-28 07:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV68122%27 HTTP/1.1" 200 None
2026-03-28 07:39:13 [auto1.de] INFO: Scrape type for AV68122: 2
2026-03-28 07:39:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ca538c8-a705-55ad-bf81-f63b19e613e4 with identifier: AV68122
2026-03-28 07:39:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ca538c8-a705-55ad-bf81-f63b19e613e4 with scrape type 2
2026-03-28 07:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ca538c8-a705-55ad-bf81-f63b19e613e4 with scrape type 2
2026-03-28 07:39:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ca538c8-a705-55ad-bf81-f63b19e613e4, identifier: AV68122
2026-03-28 07:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ca538c8-a705-55ad-bf81-f63b19e613e4 with identifier: AV68122
2026-03-28 07:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ca538c8-a705-55ad-bf81-f63b19e613e4 with identifier: AV68122
2026-03-28 07:39:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ca538c8-a705-55ad-bf81-f63b19e613e4 with identifier: AV68122 to the API
2026-03-28 07:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:13:34Z',
'fuel_type': 'petrol',
'id': '2ca538c8-a705-55ad-bf81-f63b19e613e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV68122',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 134486,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-08-29',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Highline BlueMotion Tech',
'year': 2013}
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV68122%27 HTTP/1.1" 200 None
2026-03-28 07:39:14 [auto1.de] INFO: Saving data for AV68122: {'auction_closing_time': 1774714414.0, 'created_time': 1774465882.40139, 'last_price_update_time': 1774683554.079233}
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AV68122') HTTP/1.1" 204 0
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: AX02207
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX02207%27 HTTP/1.1" 200 None
2026-03-28 07:39:14 [auto1.de] INFO: Scrape type for AX02207: 0
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: ZY72321
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: AS95642
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS95642%27 HTTP/1.1" 200 None
2026-03-28 07:39:14 [auto1.de] INFO: Scrape type for AS95642: 0
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: LN37721
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: GJ61824
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ61824%27 HTTP/1.1" 200 None
2026-03-28 07:39:14 [auto1.de] INFO: Scrape type for GJ61824: 0
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: CB57025
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB57025%27 HTTP/1.1" 200 None
2026-03-28 07:39:14 [auto1.de] INFO: Scrape type for CB57025: 0
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: FN85250
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: YF69717
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: NG94369
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG94369%27 HTTP/1.1" 200 None
2026-03-28 07:39:14 [auto1.de] INFO: Scrape type for NG94369: 0
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: VT62851
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: WW96945
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW96945%27 HTTP/1.1" 200 None
2026-03-28 07:39:14 [auto1.de] INFO: Scrape type for WW96945: 0
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: JD69388
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD69388%27 HTTP/1.1" 200 None
2026-03-28 07:39:14 [auto1.de] INFO: Scrape type for JD69388: 2
2026-03-28 07:39:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b021444d-0075-58d0-bbd4-a46aa7bf7a10 with identifier: JD69388
2026-03-28 07:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b021444d-0075-58d0-bbd4-a46aa7bf7a10 with scrape type 2
2026-03-28 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b021444d-0075-58d0-bbd4-a46aa7bf7a10 with scrape type 2
2026-03-28 07:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b021444d-0075-58d0-bbd4-a46aa7bf7a10, identifier: JD69388
2026-03-28 07:39:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b021444d-0075-58d0-bbd4-a46aa7bf7a10 with identifier: JD69388
2026-03-28 07:39:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b021444d-0075-58d0-bbd4-a46aa7bf7a10 with identifier: JD69388
2026-03-28 07:39:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b021444d-0075-58d0-bbd4-a46aa7bf7a10 with identifier: JD69388 to the API
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-28T16:15:04Z',
'fuel_type': 'diesel',
'id': 'b021444d-0075-58d0-bbd4-a46aa7bf7a10',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD69388',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 94438,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-26',
'seller_name': None,
'title': 'BMW 1er 118d',
'transmission': 'manual',
'trim': '',
'year': 2014}
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD69388%27 HTTP/1.1" 200 None
2026-03-28 07:39:14 [auto1.de] INFO: Saving data for JD69388: {'auction_closing_time': 1774714504.0, 'created_time': 1774466024.641037, 'last_price_update_time': 1774683554.634315}
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD69388') HTTP/1.1" 204 0
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: DM70532
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: RL18090
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: SS30943
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: FT69115
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: BS00232
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS00232%27 HTTP/1.1" 200 None
2026-03-28 07:39:14 [auto1.de] INFO: Scrape type for BS00232: 0
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: TW55343
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: WC00524
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC00524%27 HTTP/1.1" 200 None
2026-03-28 07:39:14 [auto1.de] INFO: Scrape type for WC00524: 0
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: ZV20362
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: XA52388
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: KU28834
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU28834%27 HTTP/1.1" 200 None
2026-03-28 07:39:14 [auto1.de] INFO: Scrape type for KU28834: 0
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: AB05978
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: VG14564
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG14564%27 HTTP/1.1" 200 None
2026-03-28 07:39:14 [auto1.de] INFO: Scrape type for VG14564: 0
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: XB95476
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: BU12505
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU12505%27 HTTP/1.1" 200 None
2026-03-28 07:39:14 [auto1.de] INFO: Scrape type for BU12505: 0
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: MA44978
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA44978%27 HTTP/1.1" 200 None
2026-03-28 07:39:14 [auto1.de] INFO: Scrape type for MA44978: 0
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: GL77539
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: ZE72511
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE72511%27 HTTP/1.1" 200 None
2026-03-28 07:39:14 [auto1.de] INFO: Scrape type for ZE72511: 0
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: VZ65007
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ65007%27 HTTP/1.1" 200 None
2026-03-28 07:39:14 [auto1.de] INFO: Scrape type for VZ65007: 0
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: MF25653
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF25653%27 HTTP/1.1" 200 None
2026-03-28 07:39:14 [auto1.de] INFO: Scrape type for MF25653: 0
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: GW56930
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: UW93361
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW93361%27 HTTP/1.1" 200 None
2026-03-28 07:39:14 [auto1.de] INFO: Scrape type for UW93361: 0
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: MC31762
2026-03-28 07:39:14 [auto1.de] INFO: Found listing with ID: HT41484
2026-03-28 07:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:39:15 [auto1.de] INFO: Channel: 24h | Page: 116 | totalHits: 9260 | hits on page: 40
2026-03-28 07:39:15 [auto1.de] INFO: Found listing with ID: CG76921
2026-03-28 07:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG76921%27 HTTP/1.1" 200 None
2026-03-28 07:39:15 [auto1.de] INFO: Scrape type for CG76921: 0
2026-03-28 07:39:16 [auto1.de] INFO: Found listing with ID: TL37084
2026-03-28 07:39:16 [auto1.de] INFO: Found listing with ID: TW05581
2026-03-28 07:39:16 [auto1.de] INFO: Found listing with ID: RD14562
2026-03-28 07:39:16 [auto1.de] INFO: Found listing with ID: FB48782
2026-03-28 07:39:16 [auto1.de] INFO: Found listing with ID: BE47693
2026-03-28 07:39:16 [auto1.de] INFO: Found listing with ID: HS17931
2026-03-28 07:39:16 [auto1.de] INFO: Found listing with ID: YC46871
2026-03-28 07:39:16 [auto1.de] INFO: Found listing with ID: VZ15910
2026-03-28 07:39:16 [auto1.de] INFO: Found listing with ID: FB20654
2026-03-28 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB20654%27 HTTP/1.1" 200 None
2026-03-28 07:39:16 [auto1.de] INFO: Scrape type for FB20654: 0
2026-03-28 07:39:16 [auto1.de] INFO: Found listing with ID: HU58633
2026-03-28 07:39:16 [auto1.de] INFO: Found listing with ID: CF91602
2026-03-28 07:39:16 [auto1.de] INFO: Found listing with ID: YZ29676
2026-03-28 07:39:16 [auto1.de] INFO: Found listing with ID: MN47186
2026-03-28 07:39:16 [auto1.de] INFO: Found listing with ID: FF65657
2026-03-28 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF65657%27 HTTP/1.1" 200 None
2026-03-28 07:39:16 [auto1.de] INFO: Scrape type for FF65657: 2
2026-03-28 07:39:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cfd8ffc-e9cb-5df5-a4d9-198a922ce532 with identifier: FF65657
2026-03-28 07:39:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cfd8ffc-e9cb-5df5-a4d9-198a922ce532 with scrape type 2
2026-03-28 07:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cfd8ffc-e9cb-5df5-a4d9-198a922ce532 with scrape type 2
2026-03-28 07:39:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7cfd8ffc-e9cb-5df5-a4d9-198a922ce532, identifier: FF65657
2026-03-28 07:39:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7cfd8ffc-e9cb-5df5-a4d9-198a922ce532 with identifier: FF65657
2026-03-28 07:39:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7cfd8ffc-e9cb-5df5-a4d9-198a922ce532 with identifier: FF65657
2026-03-28 07:39:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7cfd8ffc-e9cb-5df5-a4d9-198a922ce532 with identifier: FF65657 to the API
2026-03-28 07:39:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:20:23Z',
'fuel_type': 'petrol',
'id': '7cfd8ffc-e9cb-5df5-a4d9-198a922ce532',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF65657',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 287238,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-04',
'seller_name': None,
'title': 'Skoda Fabia 1.2 TSI Family',
'transmission': 'manual',
'trim': 'Family',
'year': 2013}
2026-03-28 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF65657%27 HTTP/1.1" 200 None
2026-03-28 07:39:16 [auto1.de] INFO: Saving data for FF65657: {'auction_closing_time': 1774714823.0, 'created_time': 1774467735.385367, 'last_price_update_time': 1774683556.477387}
2026-03-28 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF65657') HTTP/1.1" 204 0
2026-03-28 07:39:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:39:16 [auto1.de] INFO: Found listing with ID: WM87026
2026-03-28 07:39:16 [auto1.de] INFO: Found listing with ID: KF98082
2026-03-28 07:39:16 [auto1.de] INFO: Found listing with ID: FR75533
2026-03-28 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR75533%27 HTTP/1.1" 200 None
2026-03-28 07:39:16 [auto1.de] INFO: Scrape type for FR75533: 0
2026-03-28 07:39:16 [auto1.de] INFO: Found listing with ID: FE80519
2026-03-28 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE80519%27 HTTP/1.1" 200 None
2026-03-28 07:39:16 [auto1.de] INFO: Scrape type for FE80519: 0
2026-03-28 07:39:16 [auto1.de] INFO: Found listing with ID: CS88634
2026-03-28 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS88634%27 HTTP/1.1" 200 None
2026-03-28 07:39:16 [auto1.de] INFO: Scrape type for CS88634: 0
2026-03-28 07:39:16 [auto1.de] INFO: Found listing with ID: HX41929
2026-03-28 07:39:16 [auto1.de] INFO: Found listing with ID: RW09760
2026-03-28 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW09760%27 HTTP/1.1" 200 None
2026-03-28 07:39:16 [auto1.de] INFO: Scrape type for RW09760: 2
2026-03-28 07:39:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b84e8fa5-03a4-5a74-9875-2ecdf36d688c with identifier: RW09760
2026-03-28 07:39:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b84e8fa5-03a4-5a74-9875-2ecdf36d688c with scrape type 2
2026-03-28 07:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b84e8fa5-03a4-5a74-9875-2ecdf36d688c with scrape type 2
2026-03-28 07:39:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b84e8fa5-03a4-5a74-9875-2ecdf36d688c, identifier: RW09760
2026-03-28 07:39:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b84e8fa5-03a4-5a74-9875-2ecdf36d688c with identifier: RW09760
2026-03-28 07:39:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b84e8fa5-03a4-5a74-9875-2ecdf36d688c with identifier: RW09760
2026-03-28 07:39:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b84e8fa5-03a4-5a74-9875-2ecdf36d688c with identifier: RW09760 to the API
2026-03-28 07:39:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 114,
'expiration_date': '2026-03-28T16:02:10Z',
'fuel_type': 'petrol',
'id': 'b84e8fa5-03a4-5a74-9875-2ecdf36d688c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW09760',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 46229,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-08',
'seller_name': None,
'title': 'Volkswagen Caddy 1.5 TSI',
'transmission': 'automatic',
'trim': '',
'year': 2021}
2026-03-28 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW09760%27 HTTP/1.1" 200 None
2026-03-28 07:39:17 [auto1.de] INFO: Saving data for RW09760: {'auction_closing_time': 1774713730.0, 'created_time': 1774510235.452364, 'last_price_update_time': 1774683557.074375}
2026-03-28 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW09760') HTTP/1.1" 204 0
2026-03-28 07:39:17 [auto1.de] INFO: Found listing with ID: YY13895
2026-03-28 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY13895%27 HTTP/1.1" 200 None
2026-03-28 07:39:17 [auto1.de] INFO: Scrape type for YY13895: 0
2026-03-28 07:39:17 [auto1.de] INFO: Found listing with ID: SS50589
2026-03-28 07:39:17 [auto1.de] INFO: Found listing with ID: JJ00785
2026-03-28 07:39:17 [auto1.de] INFO: Found listing with ID: GK14765
2026-03-28 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK14765%27 HTTP/1.1" 200 None
2026-03-28 07:39:17 [auto1.de] INFO: Scrape type for GK14765: 2
2026-03-28 07:39:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 219a24ac-0e76-5fda-8797-61a6715c565a with identifier: GK14765
2026-03-28 07:39:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 219a24ac-0e76-5fda-8797-61a6715c565a with scrape type 2
2026-03-28 07:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 219a24ac-0e76-5fda-8797-61a6715c565a with scrape type 2
2026-03-28 07:39:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 219a24ac-0e76-5fda-8797-61a6715c565a, identifier: GK14765
2026-03-28 07:39:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 219a24ac-0e76-5fda-8797-61a6715c565a with identifier: GK14765
2026-03-28 07:39:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 219a24ac-0e76-5fda-8797-61a6715c565a with identifier: GK14765
2026-03-28 07:39:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 219a24ac-0e76-5fda-8797-61a6715c565a with identifier: GK14765 to the API
2026-03-28 07:39:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:45:31Z',
'fuel_type': 'petrol',
'id': '219a24ac-0e76-5fda-8797-61a6715c565a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK14765',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 136024,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-21',
'seller_name': None,
'title': 'Ford Fiesta 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2013}
2026-03-28 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK14765%27 HTTP/1.1" 200 None
2026-03-28 07:39:17 [auto1.de] INFO: Saving data for GK14765: {'auction_closing_time': 1774716331.0, 'created_time': 1774466910.101839, 'last_price_update_time': 1774683557.527791}
2026-03-28 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK14765') HTTP/1.1" 204 0
2026-03-28 07:39:17 [auto1.de] INFO: Found listing with ID: RC56290
2026-03-28 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC56290%27 HTTP/1.1" 200 None
2026-03-28 07:39:17 [auto1.de] INFO: Scrape type for RC56290: 0
2026-03-28 07:39:17 [auto1.de] INFO: Found listing with ID: AU99703
2026-03-28 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU99703%27 HTTP/1.1" 200 None
2026-03-28 07:39:17 [auto1.de] INFO: Scrape type for AU99703: 2
2026-03-28 07:39:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1236c9c-5744-5503-bb3b-74015f186529 with identifier: AU99703
2026-03-28 07:39:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1236c9c-5744-5503-bb3b-74015f186529 with scrape type 2
2026-03-28 07:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1236c9c-5744-5503-bb3b-74015f186529 with scrape type 2
2026-03-28 07:39:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1236c9c-5744-5503-bb3b-74015f186529, identifier: AU99703
2026-03-28 07:39:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1236c9c-5744-5503-bb3b-74015f186529 with identifier: AU99703
2026-03-28 07:39:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1236c9c-5744-5503-bb3b-74015f186529 with identifier: AU99703
2026-03-28 07:39:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1236c9c-5744-5503-bb3b-74015f186529 with identifier: AU99703 to the API
2026-03-28 07:39:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:13:26Z',
'fuel_type': 'diesel',
'id': 'b1236c9c-5744-5503-bb3b-74015f186529',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU99703',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 202455,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-29',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2018}
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU99703%27 HTTP/1.1" 200 None
2026-03-28 07:39:18 [auto1.de] INFO: Saving data for AU99703: {'auction_closing_time': 1774714406.0, 'created_time': 1774031831.509064, 'last_price_update_time': 1774683558.136198}
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU99703') HTTP/1.1" 204 0
2026-03-28 07:39:18 [auto1.de] INFO: Found listing with ID: XU63236
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU63236%27 HTTP/1.1" 200 None
2026-03-28 07:39:18 [auto1.de] INFO: Scrape type for XU63236: 0
2026-03-28 07:39:18 [auto1.de] INFO: Found listing with ID: UH34281
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH34281%27 HTTP/1.1" 200 None
2026-03-28 07:39:18 [auto1.de] INFO: Scrape type for UH34281: 0
2026-03-28 07:39:18 [auto1.de] INFO: Found listing with ID: MT28952
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT28952%27 HTTP/1.1" 200 None
2026-03-28 07:39:18 [auto1.de] INFO: Scrape type for MT28952: 0
2026-03-28 07:39:18 [auto1.de] INFO: Found listing with ID: DX28979
2026-03-28 07:39:18 [auto1.de] INFO: Found listing with ID: DF27439
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF27439%27 HTTP/1.1" 200 None
2026-03-28 07:39:18 [auto1.de] INFO: Scrape type for DF27439: 2
2026-03-28 07:39:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b88d5062-f0c0-57ea-a1b9-b9704dea4b6f with identifier: DF27439
2026-03-28 07:39:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b88d5062-f0c0-57ea-a1b9-b9704dea4b6f with scrape type 2
2026-03-28 07:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b88d5062-f0c0-57ea-a1b9-b9704dea4b6f with scrape type 2
2026-03-28 07:39:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b88d5062-f0c0-57ea-a1b9-b9704dea4b6f, identifier: DF27439
2026-03-28 07:39:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b88d5062-f0c0-57ea-a1b9-b9704dea4b6f with identifier: DF27439
2026-03-28 07:39:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b88d5062-f0c0-57ea-a1b9-b9704dea4b6f with identifier: DF27439
2026-03-28 07:39:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b88d5062-f0c0-57ea-a1b9-b9704dea4b6f with identifier: DF27439 to the API
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-28T16:29:35Z',
'fuel_type': 'diesel',
'id': 'b88d5062-f0c0-57ea-a1b9-b9704dea4b6f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF27439',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 221190,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-20',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2010}
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF27439%27 HTTP/1.1" 200 None
2026-03-28 07:39:18 [auto1.de] INFO: Saving data for DF27439: {'auction_closing_time': 1774715375.0, 'created_time': 1773860869.434884, 'last_price_update_time': 1774683558.61168}
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF27439') HTTP/1.1" 204 0
2026-03-28 07:39:18 [auto1.de] INFO: Found listing with ID: JN60731
2026-03-28 07:39:18 [auto1.de] INFO: Found listing with ID: LX06278
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX06278%27 HTTP/1.1" 200 None
2026-03-28 07:39:18 [auto1.de] INFO: Scrape type for LX06278: 0
2026-03-28 07:39:18 [auto1.de] INFO: Found listing with ID: ZA89308
2026-03-28 07:39:18 [auto1.de] INFO: Found listing with ID: ZA98162
2026-03-28 07:39:18 [auto1.de] INFO: Found listing with ID: AS79616
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS79616%27 HTTP/1.1" 200 None
2026-03-28 07:39:18 [auto1.de] INFO: Scrape type for AS79616: 0
2026-03-28 07:39:18 [auto1.de] INFO: Found listing with ID: WS06439
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS06439%27 HTTP/1.1" 200 None
2026-03-28 07:39:18 [auto1.de] INFO: Scrape type for WS06439: 0
2026-03-28 07:39:18 [auto1.de] INFO: Found listing with ID: NJ52204
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ52204%27 HTTP/1.1" 200 None
2026-03-28 07:39:18 [auto1.de] INFO: Scrape type for NJ52204: 0
2026-03-28 07:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:39:19 [auto1.de] INFO: Channel: 24h | Page: 117 | totalHits: 9261 | hits on page: 40
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: NJ52204
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ52204%27 HTTP/1.1" 200 None
2026-03-28 07:39:19 [auto1.de] INFO: Scrape type for NJ52204: 0
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: JE63209
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: CH96061
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: VC90079
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: CK58457
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK58457%27 HTTP/1.1" 200 None
2026-03-28 07:39:19 [auto1.de] INFO: Scrape type for CK58457: 0
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: HD80802
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD80802%27 HTTP/1.1" 200 None
2026-03-28 07:39:19 [auto1.de] INFO: Scrape type for HD80802: 0
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: XR34915
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: VN57759
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: UF15161
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: HT08782
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT08782%27 HTTP/1.1" 200 None
2026-03-28 07:39:19 [auto1.de] INFO: Scrape type for HT08782: 0
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: XC12317
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC12317%27 HTTP/1.1" 200 None
2026-03-28 07:39:19 [auto1.de] INFO: Scrape type for XC12317: 0
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: BD00645
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD00645%27 HTTP/1.1" 200 None
2026-03-28 07:39:19 [auto1.de] INFO: Scrape type for BD00645: 0
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: SX16558
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: AT89899
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: SL14548
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: DG30240
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: YF64568
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: UL26956
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL26956%27 HTTP/1.1" 200 None
2026-03-28 07:39:19 [auto1.de] INFO: Scrape type for UL26956: 0
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: ET07412
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET07412%27 HTTP/1.1" 200 None
2026-03-28 07:39:19 [auto1.de] INFO: Scrape type for ET07412: 0
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: NW73502
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW73502%27 HTTP/1.1" 200 None
2026-03-28 07:39:19 [auto1.de] INFO: Scrape type for NW73502: 0
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: EA07160
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: YL11317
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: JF45279
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: CU51755
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: RC77177
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC77177%27 HTTP/1.1" 200 None
2026-03-28 07:39:19 [auto1.de] INFO: Scrape type for RC77177: 0
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: KM05428
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: TD03088
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD03088%27 HTTP/1.1" 200 None
2026-03-28 07:39:19 [auto1.de] INFO: Scrape type for TD03088: 0
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: JW61268
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: KB01548
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB01548%27 HTTP/1.1" 200 None
2026-03-28 07:39:19 [auto1.de] INFO: Scrape type for KB01548: 0
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: MY86649
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: RG61391
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: YZ28815
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: HU07313
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: HN89991
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN89991%27 HTTP/1.1" 200 None
2026-03-28 07:39:19 [auto1.de] INFO: Scrape type for HN89991: 0
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: MJ05239
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: XX95177
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: FD71544
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD71544%27 HTTP/1.1" 200 None
2026-03-28 07:39:19 [auto1.de] INFO: Scrape type for FD71544: 0
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: YT57989
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT57989%27 HTTP/1.1" 200 None
2026-03-28 07:39:19 [auto1.de] INFO: Scrape type for YT57989: 0
2026-03-28 07:39:19 [auto1.de] INFO: Found listing with ID: FJ72421
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ72421%27 HTTP/1.1" 200 None
2026-03-28 07:39:19 [auto1.de] INFO: Scrape type for FJ72421: 2
2026-03-28 07:39:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 510f143c-4216-5b74-8f7a-562243d937b2 with identifier: FJ72421
2026-03-28 07:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 510f143c-4216-5b74-8f7a-562243d937b2 with scrape type 2
2026-03-28 07:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 510f143c-4216-5b74-8f7a-562243d937b2 with scrape type 2
2026-03-28 07:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 510f143c-4216-5b74-8f7a-562243d937b2, identifier: FJ72421
2026-03-28 07:39:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 510f143c-4216-5b74-8f7a-562243d937b2 with identifier: FJ72421
2026-03-28 07:39:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 510f143c-4216-5b74-8f7a-562243d937b2 with identifier: FJ72421
2026-03-28 07:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 510f143c-4216-5b74-8f7a-562243d937b2 with identifier: FJ72421 to the API
2026-03-28 07:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 147,
'expiration_date': '2026-03-28T16:38:55Z',
'fuel_type': 'petrol',
'id': '510f143c-4216-5b74-8f7a-562243d937b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ72421',
'listing': 'auction',
'make': 'Toyota',
'model': 'Avensis',
'odometer': 142235,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-07',
'seller_name': None,
'title': 'Toyota Avensis 1.8 Sol',
'transmission': 'manual',
'trim': 'Sol',
'year': 2009}
2026-03-28 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ72421%27 HTTP/1.1" 200 None
2026-03-28 07:39:20 [auto1.de] INFO: Saving data for FJ72421: {'auction_closing_time': 1774715935.0, 'created_time': 1774465923.405875, 'last_price_update_time': 1774683560.291761}
2026-03-28 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ72421') HTTP/1.1" 204 0
2026-03-28 07:39:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:39:20 [auto1.de] INFO: Found listing with ID: LE12587
2026-03-28 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE12587%27 HTTP/1.1" 200 None
2026-03-28 07:39:20 [auto1.de] INFO: Scrape type for LE12587: 0
2026-03-28 07:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:39:22 [auto1.de] INFO: Channel: 24h | Page: 118 | totalHits: 9262 | hits on page: 40
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: LE12587
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE12587%27 HTTP/1.1" 200 None
2026-03-28 07:39:22 [auto1.de] INFO: Scrape type for LE12587: 0
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: WD76267
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD76267%27 HTTP/1.1" 200 None
2026-03-28 07:39:22 [auto1.de] INFO: Scrape type for WD76267: 0
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: KP55119
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP55119%27 HTTP/1.1" 200 None
2026-03-28 07:39:22 [auto1.de] INFO: Scrape type for KP55119: 0
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: EG37222
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: LG15498
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: TL57176
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: HU45030
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: FM34812
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM34812%27 HTTP/1.1" 200 None
2026-03-28 07:39:22 [auto1.de] INFO: Scrape type for FM34812: 0
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: SG67731
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG67731%27 HTTP/1.1" 200 None
2026-03-28 07:39:22 [auto1.de] INFO: Scrape type for SG67731: 0
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: MH30608
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH30608%27 HTTP/1.1" 200 None
2026-03-28 07:39:22 [auto1.de] INFO: Scrape type for MH30608: 0
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: CU73818
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU73818%27 HTTP/1.1" 200 None
2026-03-28 07:39:22 [auto1.de] INFO: Scrape type for CU73818: 2
2026-03-28 07:39:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eaa24229-65a2-5b26-b18f-a7f15e5ce36f with identifier: CU73818
2026-03-28 07:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eaa24229-65a2-5b26-b18f-a7f15e5ce36f with scrape type 2
2026-03-28 07:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eaa24229-65a2-5b26-b18f-a7f15e5ce36f with scrape type 2
2026-03-28 07:39:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eaa24229-65a2-5b26-b18f-a7f15e5ce36f, identifier: CU73818
2026-03-28 07:39:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eaa24229-65a2-5b26-b18f-a7f15e5ce36f with identifier: CU73818
2026-03-28 07:39:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eaa24229-65a2-5b26-b18f-a7f15e5ce36f with identifier: CU73818
2026-03-28 07:39:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eaa24229-65a2-5b26-b18f-a7f15e5ce36f with identifier: CU73818 to the API
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:28:58Z',
'fuel_type': 'diesel',
'id': 'eaa24229-65a2-5b26-b18f-a7f15e5ce36f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU73818',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Amarok',
'odometer': 100034,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-07',
'seller_name': None,
'title': 'Volkswagen Amarok 2.0 TDI Trendline DoubleCab 4Motion',
'transmission': 'manual',
'trim': 'Trendline DoubleCab 4Motion',
'year': 2014}
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU73818%27 HTTP/1.1" 200 None
2026-03-28 07:39:22 [auto1.de] INFO: Saving data for CU73818: {'auction_closing_time': 1774715338.0, 'created_time': 1774467624.233998, 'last_price_update_time': 1774683562.715573}
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU73818') HTTP/1.1" 204 0
2026-03-28 07:39:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: DW20402
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW20402%27 HTTP/1.1" 200 None
2026-03-28 07:39:22 [auto1.de] INFO: Scrape type for DW20402: 0
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: YB47144
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB47144%27 HTTP/1.1" 200 None
2026-03-28 07:39:22 [auto1.de] INFO: Scrape type for YB47144: 0
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: WG55926
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG55926%27 HTTP/1.1" 200 None
2026-03-28 07:39:22 [auto1.de] INFO: Scrape type for WG55926: 0
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: AA30425
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA30425%27 HTTP/1.1" 200 None
2026-03-28 07:39:22 [auto1.de] INFO: Scrape type for AA30425: 0
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: HT53845
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: MF98327
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF98327%27 HTTP/1.1" 200 None
2026-03-28 07:39:22 [auto1.de] INFO: Scrape type for MF98327: 0
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: TR03247
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR03247%27 HTTP/1.1" 200 None
2026-03-28 07:39:22 [auto1.de] INFO: Scrape type for TR03247: 0
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: CU78638
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: TS65125
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: EU98670
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: ED90812
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED90812%27 HTTP/1.1" 200 None
2026-03-28 07:39:22 [auto1.de] INFO: Scrape type for ED90812: 0
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: ZF63164
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF63164%27 HTTP/1.1" 200 None
2026-03-28 07:39:22 [auto1.de] INFO: Scrape type for ZF63164: 0
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: DE00247
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE00247%27 HTTP/1.1" 200 None
2026-03-28 07:39:22 [auto1.de] INFO: Scrape type for DE00247: 0
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: AC85459
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: YS77012
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: ZW18782
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: LR98326
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR98326%27 HTTP/1.1" 200 None
2026-03-28 07:39:22 [auto1.de] INFO: Scrape type for LR98326: 0
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: DB10875
2026-03-28 07:39:22 [auto1.de] INFO: Found listing with ID: SW52819
2026-03-28 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW52819%27 HTTP/1.1" 200 None
2026-03-28 07:39:23 [auto1.de] INFO: Scrape type for SW52819: 0
2026-03-28 07:39:23 [auto1.de] INFO: Found listing with ID: WK09344
2026-03-28 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK09344%27 HTTP/1.1" 200 None
2026-03-28 07:39:23 [auto1.de] INFO: Scrape type for WK09344: 0
2026-03-28 07:39:23 [auto1.de] INFO: Found listing with ID: PK14357
2026-03-28 07:39:23 [auto1.de] INFO: Found listing with ID: NC06801
2026-03-28 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC06801%27 HTTP/1.1" 200 None
2026-03-28 07:39:23 [auto1.de] INFO: Scrape type for NC06801: 0
2026-03-28 07:39:23 [auto1.de] INFO: Found listing with ID: WK26503
2026-03-28 07:39:23 [auto1.de] INFO: Found listing with ID: EJ26253
2026-03-28 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ26253%27 HTTP/1.1" 200 None
2026-03-28 07:39:23 [auto1.de] INFO: Scrape type for EJ26253: 2
2026-03-28 07:39:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b93f198a-6710-505e-b8c9-9a36eba58054 with identifier: EJ26253
2026-03-28 07:39:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b93f198a-6710-505e-b8c9-9a36eba58054 with scrape type 2
2026-03-28 07:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b93f198a-6710-505e-b8c9-9a36eba58054 with scrape type 2
2026-03-28 07:39:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b93f198a-6710-505e-b8c9-9a36eba58054, identifier: EJ26253
2026-03-28 07:39:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b93f198a-6710-505e-b8c9-9a36eba58054 with identifier: EJ26253
2026-03-28 07:39:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b93f198a-6710-505e-b8c9-9a36eba58054 with identifier: EJ26253
2026-03-28 07:39:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b93f198a-6710-505e-b8c9-9a36eba58054 with identifier: EJ26253 to the API
2026-03-28 07:39:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:50:46Z',
'fuel_type': 'petrol',
'id': 'b93f198a-6710-505e-b8c9-9a36eba58054',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ26253',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 108605,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-07',
'seller_name': None,
'title': 'BMW 3er 318i Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2016}
2026-03-28 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ26253%27 HTTP/1.1" 200 None
2026-03-28 07:39:23 [auto1.de] INFO: Saving data for EJ26253: {'auction_closing_time': 1774716646.0, 'created_time': 1774466199.085906, 'last_price_update_time': 1774683563.469282}
2026-03-28 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ26253') HTTP/1.1" 204 0
2026-03-28 07:39:23 [auto1.de] INFO: Found listing with ID: BZ18787
2026-03-28 07:39:23 [auto1.de] INFO: Found listing with ID: RC48761
2026-03-28 07:39:23 [auto1.de] INFO: Found listing with ID: GP42203
2026-03-28 07:39:23 [auto1.de] INFO: Found listing with ID: NJ15905
2026-03-28 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ15905%27 HTTP/1.1" 200 None
2026-03-28 07:39:23 [auto1.de] INFO: Scrape type for NJ15905: 0
2026-03-28 07:39:23 [auto1.de] INFO: Found listing with ID: GG24255
2026-03-28 07:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:39:24 [auto1.de] INFO: Channel: 24h | Page: 119 | totalHits: 9263 | hits on page: 40
2026-03-28 07:39:24 [auto1.de] INFO: Found listing with ID: GG24255
2026-03-28 07:39:24 [auto1.de] INFO: Found listing with ID: VE81778
2026-03-28 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE81778%27 HTTP/1.1" 200 None
2026-03-28 07:39:24 [auto1.de] INFO: Scrape type for VE81778: 2
2026-03-28 07:39:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d3de502-3aee-5fd3-9e96-2355f6652e70 with identifier: VE81778
2026-03-28 07:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d3de502-3aee-5fd3-9e96-2355f6652e70 with scrape type 2
2026-03-28 07:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d3de502-3aee-5fd3-9e96-2355f6652e70 with scrape type 2
2026-03-28 07:39:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d3de502-3aee-5fd3-9e96-2355f6652e70, identifier: VE81778
2026-03-28 07:39:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d3de502-3aee-5fd3-9e96-2355f6652e70 with identifier: VE81778
2026-03-28 07:39:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d3de502-3aee-5fd3-9e96-2355f6652e70 with identifier: VE81778
2026-03-28 07:39:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d3de502-3aee-5fd3-9e96-2355f6652e70 with identifier: VE81778 to the API
2026-03-28 07:39:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:07:20Z',
'fuel_type': 'diesel',
'id': '1d3de502-3aee-5fd3-9e96-2355f6652e70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE81778',
'listing': 'auction',
'make': 'Renault',
'model': 'Trafic',
'odometer': 198826,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-11-17',
'seller_name': None,
'title': 'Renault Trafic 2.5 dCi L1H1 2,7t verglast',
'transmission': 'manual',
'trim': 'L1H1 2,7t verglast',
'year': 2003}
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE81778%27 HTTP/1.1" 200 None
2026-03-28 07:39:25 [auto1.de] INFO: Saving data for VE81778: {'auction_closing_time': 1774714040.0, 'created_time': 1774467397.225969, 'last_price_update_time': 1774683565.014999}
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE81778') HTTP/1.1" 204 0
2026-03-28 07:39:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: BZ53185
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ53185%27 HTTP/1.1" 200 None
2026-03-28 07:39:25 [auto1.de] INFO: Scrape type for BZ53185: 0
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: GV82392
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: MY91371
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: JN55022
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN55022%27 HTTP/1.1" 200 None
2026-03-28 07:39:25 [auto1.de] INFO: Scrape type for JN55022: 0
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: DL82245
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: KU16473
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU16473%27 HTTP/1.1" 200 None
2026-03-28 07:39:25 [auto1.de] INFO: Scrape type for KU16473: 0
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: BM91170
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: KH11075
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH11075%27 HTTP/1.1" 200 None
2026-03-28 07:39:25 [auto1.de] INFO: Scrape type for KH11075: 0
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: PW43450
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW43450%27 HTTP/1.1" 200 None
2026-03-28 07:39:25 [auto1.de] INFO: Scrape type for PW43450: 0
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: AA38462
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: TZ59540
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: UA38092
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA38092%27 HTTP/1.1" 200 None
2026-03-28 07:39:25 [auto1.de] INFO: Scrape type for UA38092: 0
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: SP61181
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: NG71684
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: LX58961
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX58961%27 HTTP/1.1" 200 None
2026-03-28 07:39:25 [auto1.de] INFO: Scrape type for LX58961: 0
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: CA26393
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: WC25701
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC25701%27 HTTP/1.1" 200 None
2026-03-28 07:39:25 [auto1.de] INFO: Scrape type for WC25701: 0
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: TG41026
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: NZ09394
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ09394%27 HTTP/1.1" 200 None
2026-03-28 07:39:25 [auto1.de] INFO: Scrape type for NZ09394: 2
2026-03-28 07:39:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49208e0b-bf05-57ad-9c3a-b525e6c011a8 with identifier: NZ09394
2026-03-28 07:39:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49208e0b-bf05-57ad-9c3a-b525e6c011a8 with scrape type 2
2026-03-28 07:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49208e0b-bf05-57ad-9c3a-b525e6c011a8 with scrape type 2
2026-03-28 07:39:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49208e0b-bf05-57ad-9c3a-b525e6c011a8, identifier: NZ09394
2026-03-28 07:39:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49208e0b-bf05-57ad-9c3a-b525e6c011a8 with identifier: NZ09394
2026-03-28 07:39:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49208e0b-bf05-57ad-9c3a-b525e6c011a8 with identifier: NZ09394
2026-03-28 07:39:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49208e0b-bf05-57ad-9c3a-b525e6c011a8 with identifier: NZ09394 to the API
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:40:03Z',
'fuel_type': 'diesel',
'id': '49208e0b-bf05-57ad-9c3a-b525e6c011a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ09394',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 148837,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-18',
'seller_name': None,
'title': 'Ford Mondeo 1.5 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2017}
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ09394%27 HTTP/1.1" 200 None
2026-03-28 07:39:25 [auto1.de] INFO: Saving data for NZ09394: {'auction_closing_time': 1774716003.0, 'created_time': 1774466952.869642, 'last_price_update_time': 1774683565.571973}
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ09394') HTTP/1.1" 204 0
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: RU02977
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: UW98982
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: YL01247
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: RZ83508
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ83508%27 HTTP/1.1" 200 None
2026-03-28 07:39:25 [auto1.de] INFO: Scrape type for RZ83508: 0
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: NV84583
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV84583%27 HTTP/1.1" 200 None
2026-03-28 07:39:25 [auto1.de] INFO: Scrape type for NV84583: 0
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: ZW60338
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: DH44526
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH44526%27 HTTP/1.1" 200 None
2026-03-28 07:39:25 [auto1.de] INFO: Scrape type for DH44526: 0
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: ZL58365
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: TH77412
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH77412%27 HTTP/1.1" 200 None
2026-03-28 07:39:25 [auto1.de] INFO: Scrape type for TH77412: 0
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: LS75303
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: CH57776
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: SE89354
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: FH51774
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: DF27266
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF27266%27 HTTP/1.1" 200 None
2026-03-28 07:39:25 [auto1.de] INFO: Scrape type for DF27266: 0
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: XH15947
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: ZZ35874
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: TK74975
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: LA13205
2026-03-28 07:39:25 [auto1.de] INFO: Found listing with ID: NP64585
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP64585%27 HTTP/1.1" 200 None
2026-03-28 07:39:25 [auto1.de] INFO: Scrape type for NP64585: 0
2026-03-28 07:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:39:26 [auto1.de] INFO: Channel: 24h | Page: 120 | totalHits: 9263 | hits on page: 40
2026-03-28 07:39:26 [auto1.de] INFO: Found listing with ID: VH79690
2026-03-28 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH79690%27 HTTP/1.1" 200 None
2026-03-28 07:39:26 [auto1.de] INFO: Scrape type for VH79690: 0
2026-03-28 07:39:26 [auto1.de] INFO: Found listing with ID: DM73323
2026-03-28 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM73323%27 HTTP/1.1" 200 None
2026-03-28 07:39:26 [auto1.de] INFO: Scrape type for DM73323: 2
2026-03-28 07:39:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 956bbbc0-5af0-55b7-b067-ec8a89c0dd30 with identifier: DM73323
2026-03-28 07:39:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 956bbbc0-5af0-55b7-b067-ec8a89c0dd30 with scrape type 2
2026-03-28 07:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 956bbbc0-5af0-55b7-b067-ec8a89c0dd30 with scrape type 2
2026-03-28 07:39:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 956bbbc0-5af0-55b7-b067-ec8a89c0dd30, identifier: DM73323
2026-03-28 07:39:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 956bbbc0-5af0-55b7-b067-ec8a89c0dd30 with identifier: DM73323
2026-03-28 07:39:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:39:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-28 07:39:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:39:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 956bbbc0-5af0-55b7-b067-ec8a89c0dd30 with identifier: DM73323
2026-03-28 07:39:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 956bbbc0-5af0-55b7-b067-ec8a89c0dd30 with identifier: DM73323 to the API
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:43:00Z',
'fuel_type': 'petrol',
'id': '956bbbc0-5af0-55b7-b067-ec8a89c0dd30',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM73323',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 79560,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-07',
'seller_name': None,
'title': 'Seat Ibiza 1.0 TSI XCellence',
'transmission': 'manual',
'trim': 'XCellence',
'year': 2017}
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM73323%27 HTTP/1.1" 200 None
2026-03-28 07:39:27 [auto1.de] INFO: Saving data for DM73323: {'auction_closing_time': 1774716180.0, 'created_time': 1774503054.962134, 'last_price_update_time': 1774683567.268669}
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM73323') HTTP/1.1" 204 0
2026-03-28 07:39:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: ZE48308
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: LZ19661
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ19661%27 HTTP/1.1" 200 None
2026-03-28 07:39:27 [auto1.de] INFO: Scrape type for LZ19661: 0
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: ZA98026
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA98026%27 HTTP/1.1" 200 None
2026-03-28 07:39:27 [auto1.de] INFO: Scrape type for ZA98026: 0
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: TJ01230
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ01230%27 HTTP/1.1" 200 None
2026-03-28 07:39:27 [auto1.de] INFO: Scrape type for TJ01230: 0
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: CE41474
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: UA25868
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: DD25870
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: ZJ06184
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: LF82683
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF82683%27 HTTP/1.1" 200 None
2026-03-28 07:39:27 [auto1.de] INFO: Scrape type for LF82683: 0
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: HB06049
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB06049%27 HTTP/1.1" 200 None
2026-03-28 07:39:27 [auto1.de] INFO: Scrape type for HB06049: 0
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: TA27217
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: LY60106
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY60106%27 HTTP/1.1" 200 None
2026-03-28 07:39:27 [auto1.de] INFO: Scrape type for LY60106: 0
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: AR87733
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: YC79153
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC79153%27 HTTP/1.1" 200 None
2026-03-28 07:39:27 [auto1.de] INFO: Scrape type for YC79153: 0
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: GC94975
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC94975%27 HTTP/1.1" 200 None
2026-03-28 07:39:27 [auto1.de] INFO: Scrape type for GC94975: 0
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: AH65179
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65179%27 HTTP/1.1" 200 None
2026-03-28 07:39:27 [auto1.de] INFO: Scrape type for AH65179: 0
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: FW46825
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW46825%27 HTTP/1.1" 200 None
2026-03-28 07:39:27 [auto1.de] INFO: Scrape type for FW46825: 0
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: VA68941
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: XE63092
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE63092%27 HTTP/1.1" 200 None
2026-03-28 07:39:27 [auto1.de] INFO: Scrape type for XE63092: 0
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: DN95746
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: GX07003
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: VS28124
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: PF14640
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: GL70534
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: CH21169
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH21169%27 HTTP/1.1" 200 None
2026-03-28 07:39:27 [auto1.de] INFO: Scrape type for CH21169: 0
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: KA16702
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA16702%27 HTTP/1.1" 200 None
2026-03-28 07:39:27 [auto1.de] INFO: Scrape type for KA16702: 0
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: UU48969
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: BY37084
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: EL19889
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL19889%27 HTTP/1.1" 200 None
2026-03-28 07:39:27 [auto1.de] INFO: Scrape type for EL19889: 0
2026-03-28 07:39:27 [auto1.de] INFO: Found listing with ID: BS54687
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS54687%27 HTTP/1.1" 200 None
2026-03-28 07:39:27 [auto1.de] INFO: Scrape type for BS54687: 2
2026-03-28 07:39:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b227b8bd-8823-599d-ad79-6dea7d614935 with identifier: BS54687
2026-03-28 07:39:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b227b8bd-8823-599d-ad79-6dea7d614935 with scrape type 2
2026-03-28 07:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b227b8bd-8823-599d-ad79-6dea7d614935 with scrape type 2
2026-03-28 07:39:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b227b8bd-8823-599d-ad79-6dea7d614935, identifier: BS54687
2026-03-28 07:39:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b227b8bd-8823-599d-ad79-6dea7d614935 with identifier: BS54687
2026-03-28 07:39:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b227b8bd-8823-599d-ad79-6dea7d614935 with identifier: BS54687
2026-03-28 07:39:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b227b8bd-8823-599d-ad79-6dea7d614935 with identifier: BS54687 to the API
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:21:20Z',
'fuel_type': 'petrol',
'id': 'b227b8bd-8823-599d-ad79-6dea7d614935',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS54687',
'listing': 'auction',
'make': 'Hyundai',
'model': 'ix20',
'odometer': 104379,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-18',
'seller_name': None,
'title': 'Hyundai ix20 1.6 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2012}
2026-03-28 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS54687%27 HTTP/1.1" 200 None
2026-03-28 07:39:28 [auto1.de] INFO: Saving data for BS54687: {'auction_closing_time': 1774714880.0, 'created_time': 1774468026.207504, 'last_price_update_time': 1774683568.049997}
2026-03-28 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS54687') HTTP/1.1" 204 0
2026-03-28 07:39:28 [auto1.de] INFO: Found listing with ID: EW11176
2026-03-28 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW11176%27 HTTP/1.1" 200 None
2026-03-28 07:39:28 [auto1.de] INFO: Scrape type for EW11176: 0
2026-03-28 07:39:28 [auto1.de] INFO: Found listing with ID: KA95549
2026-03-28 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA95549%27 HTTP/1.1" 200 None
2026-03-28 07:39:28 [auto1.de] INFO: Scrape type for KA95549: 0
2026-03-28 07:39:28 [auto1.de] INFO: Found listing with ID: ST87748
2026-03-28 07:39:28 [auto1.de] INFO: Found listing with ID: SV32169
2026-03-28 07:39:28 [auto1.de] INFO: Found listing with ID: EP28641
2026-03-28 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP28641%27 HTTP/1.1" 200 None
2026-03-28 07:39:28 [auto1.de] INFO: Scrape type for EP28641: 2
2026-03-28 07:39:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b514998a-a1d8-52f9-8b23-2addae7da9c8 with identifier: EP28641
2026-03-28 07:39:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b514998a-a1d8-52f9-8b23-2addae7da9c8 with scrape type 2
2026-03-28 07:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b514998a-a1d8-52f9-8b23-2addae7da9c8 with scrape type 2
2026-03-28 07:39:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b514998a-a1d8-52f9-8b23-2addae7da9c8, identifier: EP28641
2026-03-28 07:39:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b514998a-a1d8-52f9-8b23-2addae7da9c8 with identifier: EP28641
2026-03-28 07:39:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b514998a-a1d8-52f9-8b23-2addae7da9c8 with identifier: EP28641
2026-03-28 07:39:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b514998a-a1d8-52f9-8b23-2addae7da9c8 with identifier: EP28641 to the API
2026-03-28 07:39:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:06:59Z',
'fuel_type': 'diesel',
'id': 'b514998a-a1d8-52f9-8b23-2addae7da9c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP28641',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 171667,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-15',
'seller_name': None,
'title': 'Nissan Qashqai 2.0 dCi I-Way',
'transmission': 'manual',
'trim': 'I-Way',
'year': 2010}
2026-03-28 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP28641%27 HTTP/1.1" 200 None
2026-03-28 07:39:28 [auto1.de] INFO: Saving data for EP28641: {'auction_closing_time': 1774714019.0, 'created_time': 1774466656.105177, 'last_price_update_time': 1774683568.619145}
2026-03-28 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP28641') HTTP/1.1" 204 0
2026-03-28 07:39:28 [auto1.de] INFO: Found listing with ID: UU77813
2026-03-28 07:39:28 [auto1.de] INFO: Found listing with ID: RB36890
2026-03-28 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB36890%27 HTTP/1.1" 200 None
2026-03-28 07:39:28 [auto1.de] INFO: Scrape type for RB36890: 0
2026-03-28 07:39:28 [auto1.de] INFO: Found listing with ID: FX70988
2026-03-28 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX70988%27 HTTP/1.1" 200 None
2026-03-28 07:39:28 [auto1.de] INFO: Scrape type for FX70988: 0
2026-03-28 07:39:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:39:35 [auto1.de] INFO: Channel: 24h | Page: 121 | totalHits: 9263 | hits on page: 40
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: MG81975
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: RT58189
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: MD90322
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD90322%27 HTTP/1.1" 200 None
2026-03-28 07:39:35 [auto1.de] INFO: Scrape type for MD90322: 0
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: UM54862
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: HD53184
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: ZR92554
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: UZ83781
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ83781%27 HTTP/1.1" 200 None
2026-03-28 07:39:35 [auto1.de] INFO: Scrape type for UZ83781: 0
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: ZS44353
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: ZY59187
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: NZ57035
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ57035%27 HTTP/1.1" 200 None
2026-03-28 07:39:35 [auto1.de] INFO: Scrape type for NZ57035: 0
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: RW93776
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW93776%27 HTTP/1.1" 200 None
2026-03-28 07:39:35 [auto1.de] INFO: Scrape type for RW93776: 0
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: SY82090
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY82090%27 HTTP/1.1" 200 None
2026-03-28 07:39:35 [auto1.de] INFO: Scrape type for SY82090: 0
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: UA55919
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA55919%27 HTTP/1.1" 200 None
2026-03-28 07:39:35 [auto1.de] INFO: Scrape type for UA55919: 0
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: YC02535
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC02535%27 HTTP/1.1" 200 None
2026-03-28 07:39:35 [auto1.de] INFO: Scrape type for YC02535: 0
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: TV16338
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: XS74936
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS74936%27 HTTP/1.1" 200 None
2026-03-28 07:39:35 [auto1.de] INFO: Scrape type for XS74936: 0
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: UU45926
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU45926%27 HTTP/1.1" 200 None
2026-03-28 07:39:35 [auto1.de] INFO: Scrape type for UU45926: 0
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: HA14963
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: TX33214
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: HL68502
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: FS10993
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: DY94514
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: RC68587
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC68587%27 HTTP/1.1" 200 None
2026-03-28 07:39:35 [auto1.de] INFO: Scrape type for RC68587: 0
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: XV87595
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV87595%27 HTTP/1.1" 200 None
2026-03-28 07:39:35 [auto1.de] INFO: Scrape type for XV87595: 0
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: VU63720
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU63720%27 HTTP/1.1" 200 None
2026-03-28 07:39:35 [auto1.de] INFO: Scrape type for VU63720: 0
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: MR73293
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR73293%27 HTTP/1.1" 200 None
2026-03-28 07:39:35 [auto1.de] INFO: Scrape type for MR73293: 0
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: HN88809
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: UM42416
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM42416%27 HTTP/1.1" 200 None
2026-03-28 07:39:35 [auto1.de] INFO: Scrape type for UM42416: 0
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: TX80950
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: XR09135
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR09135%27 HTTP/1.1" 200 None
2026-03-28 07:39:35 [auto1.de] INFO: Scrape type for XR09135: 0
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: BK51387
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: RE06888
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE06888%27 HTTP/1.1" 200 None
2026-03-28 07:39:35 [auto1.de] INFO: Scrape type for RE06888: 0
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: HV36396
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV36396%27 HTTP/1.1" 200 None
2026-03-28 07:39:35 [auto1.de] INFO: Scrape type for HV36396: 0
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: MR55647
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR55647%27 HTTP/1.1" 200 None
2026-03-28 07:39:35 [auto1.de] INFO: Scrape type for MR55647: 0
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: ET88076
2026-03-28 07:39:35 [auto1.de] INFO: Found listing with ID: JJ41566
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ41566%27 HTTP/1.1" 200 None
2026-03-28 07:39:35 [auto1.de] INFO: Scrape type for JJ41566: 2
2026-03-28 07:39:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86dd1fe5-b6e0-5ef5-9775-fb80e2f1580e with identifier: JJ41566
2026-03-28 07:39:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86dd1fe5-b6e0-5ef5-9775-fb80e2f1580e with scrape type 2
2026-03-28 07:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86dd1fe5-b6e0-5ef5-9775-fb80e2f1580e with scrape type 2
2026-03-28 07:39:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86dd1fe5-b6e0-5ef5-9775-fb80e2f1580e, identifier: JJ41566
2026-03-28 07:39:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86dd1fe5-b6e0-5ef5-9775-fb80e2f1580e with identifier: JJ41566
2026-03-28 07:39:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86dd1fe5-b6e0-5ef5-9775-fb80e2f1580e with identifier: JJ41566
2026-03-28 07:39:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86dd1fe5-b6e0-5ef5-9775-fb80e2f1580e with identifier: JJ41566 to the API
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 160,
'expiration_date': '2026-03-28T16:52:52Z',
'fuel_type': 'petrol',
'id': '86dd1fe5-b6e0-5ef5-9775-fb80e2f1580e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ41566',
'listing': 'auction',
'make': 'Honda',
'model': 'Prelude',
'odometer': 255264,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1993-07-05',
'seller_name': None,
'title': 'Honda Prelude 2.3',
'transmission': 'automatic',
'trim': '',
'year': 1993}
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ41566%27 HTTP/1.1" 200 None
2026-03-28 07:39:35 [auto1.de] INFO: Saving data for JJ41566: {'auction_closing_time': 1774716772.0, 'created_time': 1774503046.522246, 'last_price_update_time': 1774683575.95498}
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ41566') HTTP/1.1" 204 0
2026-03-28 07:39:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:39:36 [auto1.de] INFO: Found listing with ID: RP29277
2026-03-28 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP29277%27 HTTP/1.1" 200 None
2026-03-28 07:39:36 [auto1.de] INFO: Scrape type for RP29277: 0
2026-03-28 07:39:36 [auto1.de] INFO: Found listing with ID: AD93379
2026-03-28 07:39:36 [auto1.de] INFO: Found listing with ID: HC23327
2026-03-28 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC23327%27 HTTP/1.1" 200 None
2026-03-28 07:39:36 [auto1.de] INFO: Scrape type for HC23327: 0
2026-03-28 07:39:36 [auto1.de] INFO: Found listing with ID: ZF79989
2026-03-28 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF79989%27 HTTP/1.1" 200 None
2026-03-28 07:39:36 [auto1.de] INFO: Scrape type for ZF79989: 0
2026-03-28 07:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:39:37 [auto1.de] INFO: Channel: 24h | Page: 122 | totalHits: 9263 | hits on page: 40
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: RG74932
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG74932%27 HTTP/1.1" 200 None
2026-03-28 07:39:37 [auto1.de] INFO: Scrape type for RG74932: 0
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: MY79031
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: GD70369
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: VM82441
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: YC90372
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC90372%27 HTTP/1.1" 200 None
2026-03-28 07:39:37 [auto1.de] INFO: Scrape type for YC90372: 0
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: LL58658
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL58658%27 HTTP/1.1" 200 None
2026-03-28 07:39:37 [auto1.de] INFO: Scrape type for LL58658: 0
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: LF42462
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: BP69696
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: SP94156
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: DD19418
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD19418%27 HTTP/1.1" 200 None
2026-03-28 07:39:37 [auto1.de] INFO: Scrape type for DD19418: 0
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: TF24039
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: FE29735
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE29735%27 HTTP/1.1" 200 None
2026-03-28 07:39:37 [auto1.de] INFO: Scrape type for FE29735: 0
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: MA41049
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA41049%27 HTTP/1.1" 200 None
2026-03-28 07:39:37 [auto1.de] INFO: Scrape type for MA41049: 0
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: HH04688
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: JV58210
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: AK28209
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: SL68511
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: PM76396
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: UG82717
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG82717%27 HTTP/1.1" 200 None
2026-03-28 07:39:37 [auto1.de] INFO: Scrape type for UG82717: 0
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: PN06461
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: KR96778
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR96778%27 HTTP/1.1" 200 None
2026-03-28 07:39:37 [auto1.de] INFO: Scrape type for KR96778: 2
2026-03-28 07:39:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdbc5fad-a248-56e3-a64a-6c1214b63274 with identifier: KR96778
2026-03-28 07:39:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdbc5fad-a248-56e3-a64a-6c1214b63274 with scrape type 2
2026-03-28 07:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdbc5fad-a248-56e3-a64a-6c1214b63274 with scrape type 2
2026-03-28 07:39:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdbc5fad-a248-56e3-a64a-6c1214b63274, identifier: KR96778
2026-03-28 07:39:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdbc5fad-a248-56e3-a64a-6c1214b63274 with identifier: KR96778
2026-03-28 07:39:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdbc5fad-a248-56e3-a64a-6c1214b63274 with identifier: KR96778
2026-03-28 07:39:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdbc5fad-a248-56e3-a64a-6c1214b63274 with identifier: KR96778 to the API
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:36:53Z',
'fuel_type': 'diesel',
'id': 'cdbc5fad-a248-56e3-a64a-6c1214b63274',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR96778',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 California',
'odometer': 165709,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-13',
'seller_name': None,
'title': 'Volkswagen T6 California 2.0 TDI Beach Edition 4Motion',
'transmission': 'automatic',
'trim': 'Beach Edition 4Motion',
'year': 2016}
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR96778%27 HTTP/1.1" 200 None
2026-03-28 07:39:37 [auto1.de] INFO: Saving data for KR96778: {'auction_closing_time': 1774715813.0, 'created_time': 1773859300.937866, 'last_price_update_time': 1774683577.767553}
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR96778') HTTP/1.1" 204 0
2026-03-28 07:39:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: JZ77542
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: YR27652
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR27652%27 HTTP/1.1" 200 None
2026-03-28 07:39:37 [auto1.de] INFO: Scrape type for YR27652: 0
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: WP16305
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: KW34660
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: KC21551
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: XN24576
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: GJ45514
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ45514%27 HTTP/1.1" 200 None
2026-03-28 07:39:37 [auto1.de] INFO: Scrape type for GJ45514: 0
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: GE52020
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE52020%27 HTTP/1.1" 200 None
2026-03-28 07:39:37 [auto1.de] INFO: Scrape type for GE52020: 0
2026-03-28 07:39:37 [auto1.de] INFO: Found listing with ID: DR31322
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR31322%27 HTTP/1.1" 200 None
2026-03-28 07:39:37 [auto1.de] INFO: Scrape type for DR31322: 2
2026-03-28 07:39:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d9511f1-ad34-57b8-9122-15f87e2aa853 with identifier: DR31322
2026-03-28 07:39:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d9511f1-ad34-57b8-9122-15f87e2aa853 with scrape type 2
2026-03-28 07:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d9511f1-ad34-57b8-9122-15f87e2aa853 with scrape type 2
2026-03-28 07:39:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d9511f1-ad34-57b8-9122-15f87e2aa853, identifier: DR31322
2026-03-28 07:39:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d9511f1-ad34-57b8-9122-15f87e2aa853 with identifier: DR31322
2026-03-28 07:39:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d9511f1-ad34-57b8-9122-15f87e2aa853 with identifier: DR31322
2026-03-28 07:39:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d9511f1-ad34-57b8-9122-15f87e2aa853 with identifier: DR31322 to the API
2026-03-28 07:39:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 300,
'expiration_date': '2026-03-28T16:22:33Z',
'fuel_type': 'diesel',
'id': '0d9511f1-ad34-57b8-9122-15f87e2aa853',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR31322',
'listing': 'auction',
'make': 'Jaguar',
'model': 'XF',
'odometer': 130690,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-03',
'seller_name': None,
'title': 'Jaguar XF 30d Portfolio',
'transmission': 'automatic',
'trim': 'Portfolio',
'year': 2017}
2026-03-28 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR31322%27 HTTP/1.1" 200 None
2026-03-28 07:39:38 [auto1.de] INFO: Saving data for DR31322: {'auction_closing_time': 1774714953.0, 'created_time': 1773223753.060816, 'last_price_update_time': 1774683578.370803}
2026-03-28 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR31322') HTTP/1.1" 204 0
2026-03-28 07:39:38 [auto1.de] INFO: Found listing with ID: CM78973
2026-03-28 07:39:38 [auto1.de] INFO: Found listing with ID: MV77064
2026-03-28 07:39:38 [auto1.de] INFO: Found listing with ID: EM22494
2026-03-28 07:39:38 [auto1.de] INFO: Found listing with ID: GH26905
2026-03-28 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH26905%27 HTTP/1.1" 200 None
2026-03-28 07:39:38 [auto1.de] INFO: Scrape type for GH26905: 0
2026-03-28 07:39:38 [auto1.de] INFO: Found listing with ID: NZ42181
2026-03-28 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ42181%27 HTTP/1.1" 200 None
2026-03-28 07:39:38 [auto1.de] INFO: Scrape type for NZ42181: 0
2026-03-28 07:39:38 [auto1.de] INFO: Found listing with ID: YJ21750
2026-03-28 07:39:38 [auto1.de] INFO: Found listing with ID: KA69017
2026-03-28 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA69017%27 HTTP/1.1" 200 None
2026-03-28 07:39:38 [auto1.de] INFO: Scrape type for KA69017: 0
2026-03-28 07:39:38 [auto1.de] INFO: Found listing with ID: ED62579
2026-03-28 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED62579%27 HTTP/1.1" 200 None
2026-03-28 07:39:38 [auto1.de] INFO: Scrape type for ED62579: 0
2026-03-28 07:39:38 [auto1.de] INFO: Found listing with ID: XE48983
2026-03-28 07:39:38 [auto1.de] INFO: Found listing with ID: AT80326
2026-03-28 07:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:39:39 [auto1.de] INFO: Channel: 24h | Page: 123 | totalHits: 9263 | hits on page: 40
2026-03-28 07:39:39 [auto1.de] INFO: Found listing with ID: HB66964
2026-03-28 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB66964%27 HTTP/1.1" 200 None
2026-03-28 07:39:39 [auto1.de] INFO: Scrape type for HB66964: 0
2026-03-28 07:39:39 [auto1.de] INFO: Found listing with ID: PY74539
2026-03-28 07:39:39 [auto1.de] INFO: Found listing with ID: NR20309
2026-03-28 07:39:39 [auto1.de] INFO: Found listing with ID: NS28302
2026-03-28 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS28302%27 HTTP/1.1" 200 None
2026-03-28 07:39:39 [auto1.de] INFO: Scrape type for NS28302: 0
2026-03-28 07:39:39 [auto1.de] INFO: Found listing with ID: MN42254
2026-03-28 07:39:39 [auto1.de] INFO: Found listing with ID: JU00246
2026-03-28 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU00246%27 HTTP/1.1" 200 None
2026-03-28 07:39:39 [auto1.de] INFO: Scrape type for JU00246: 0
2026-03-28 07:39:39 [auto1.de] INFO: Found listing with ID: VB81192
2026-03-28 07:39:39 [auto1.de] INFO: Found listing with ID: WN39089
2026-03-28 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN39089%27 HTTP/1.1" 200 None
2026-03-28 07:39:39 [auto1.de] INFO: Scrape type for WN39089: 0
2026-03-28 07:39:39 [auto1.de] INFO: Found listing with ID: DC41283
2026-03-28 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC41283%27 HTTP/1.1" 200 None
2026-03-28 07:39:39 [auto1.de] INFO: Scrape type for DC41283: 0
2026-03-28 07:39:39 [auto1.de] INFO: Found listing with ID: PJ34146
2026-03-28 07:39:39 [auto1.de] INFO: Found listing with ID: AM54247
2026-03-28 07:39:39 [auto1.de] INFO: Found listing with ID: DT97256
2026-03-28 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT97256%27 HTTP/1.1" 200 None
2026-03-28 07:39:39 [auto1.de] INFO: Scrape type for DT97256: 0
2026-03-28 07:39:39 [auto1.de] INFO: Found listing with ID: BE84221
2026-03-28 07:39:39 [auto1.de] INFO: Found listing with ID: PC67993
2026-03-28 07:39:39 [auto1.de] INFO: Found listing with ID: AK43100
2026-03-28 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK43100%27 HTTP/1.1" 200 None
2026-03-28 07:39:39 [auto1.de] INFO: Scrape type for AK43100: 0
2026-03-28 07:39:39 [auto1.de] INFO: Found listing with ID: WR86078
2026-03-28 07:39:39 [auto1.de] INFO: Found listing with ID: YR83365
2026-03-28 07:39:39 [auto1.de] INFO: Found listing with ID: AM86665
2026-03-28 07:39:39 [auto1.de] INFO: Found listing with ID: KL68094
2026-03-28 07:39:39 [auto1.de] INFO: Found listing with ID: LA66980
2026-03-28 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA66980%27 HTTP/1.1" 200 None
2026-03-28 07:39:39 [auto1.de] INFO: Scrape type for LA66980: 0
2026-03-28 07:39:39 [auto1.de] INFO: Found listing with ID: CC57472
2026-03-28 07:39:39 [auto1.de] INFO: Found listing with ID: SP65010
2026-03-28 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP65010%27 HTTP/1.1" 200 None
2026-03-28 07:39:39 [auto1.de] INFO: Scrape type for SP65010: 2
2026-03-28 07:39:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c983819-6c0d-5ef8-b397-cef114f57feb with identifier: SP65010
2026-03-28 07:39:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c983819-6c0d-5ef8-b397-cef114f57feb with scrape type 2
2026-03-28 07:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c983819-6c0d-5ef8-b397-cef114f57feb with scrape type 2
2026-03-28 07:39:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c983819-6c0d-5ef8-b397-cef114f57feb, identifier: SP65010
2026-03-28 07:39:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c983819-6c0d-5ef8-b397-cef114f57feb with identifier: SP65010
2026-03-28 07:39:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c983819-6c0d-5ef8-b397-cef114f57feb with identifier: SP65010
2026-03-28 07:39:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c983819-6c0d-5ef8-b397-cef114f57feb with identifier: SP65010 to the API
2026-03-28 07:39:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:14:36Z',
'fuel_type': 'diesel',
'id': '3c983819-6c0d-5ef8-b397-cef114f57feb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP65010',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 128055,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-18',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2017}
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP65010%27 HTTP/1.1" 200 None
2026-03-28 07:39:40 [auto1.de] INFO: Saving data for SP65010: {'auction_closing_time': 1774714476.0, 'created_time': 1774031740.661649, 'last_price_update_time': 1774683580.032327}
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP65010') HTTP/1.1" 204 0
2026-03-28 07:39:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:39:40 [auto1.de] INFO: Found listing with ID: NL78703
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL78703%27 HTTP/1.1" 200 None
2026-03-28 07:39:40 [auto1.de] INFO: Scrape type for NL78703: 0
2026-03-28 07:39:40 [auto1.de] INFO: Found listing with ID: VB40979
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB40979%27 HTTP/1.1" 200 None
2026-03-28 07:39:40 [auto1.de] INFO: Scrape type for VB40979: 0
2026-03-28 07:39:40 [auto1.de] INFO: Found listing with ID: XC86778
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC86778%27 HTTP/1.1" 200 None
2026-03-28 07:39:40 [auto1.de] INFO: Scrape type for XC86778: 0
2026-03-28 07:39:40 [auto1.de] INFO: Found listing with ID: FT42679
2026-03-28 07:39:40 [auto1.de] INFO: Found listing with ID: VJ42576
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ42576%27 HTTP/1.1" 200 None
2026-03-28 07:39:40 [auto1.de] INFO: Scrape type for VJ42576: 0
2026-03-28 07:39:40 [auto1.de] INFO: Found listing with ID: ZA60248
2026-03-28 07:39:40 [auto1.de] INFO: Found listing with ID: JR79964
2026-03-28 07:39:40 [auto1.de] INFO: Found listing with ID: KP25975
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP25975%27 HTTP/1.1" 200 None
2026-03-28 07:39:40 [auto1.de] INFO: Scrape type for KP25975: 0
2026-03-28 07:39:40 [auto1.de] INFO: Found listing with ID: VF94022
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF94022%27 HTTP/1.1" 200 None
2026-03-28 07:39:40 [auto1.de] INFO: Scrape type for VF94022: 0
2026-03-28 07:39:40 [auto1.de] INFO: Found listing with ID: ZX49680
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX49680%27 HTTP/1.1" 200 None
2026-03-28 07:39:40 [auto1.de] INFO: Scrape type for ZX49680: 0
2026-03-28 07:39:40 [auto1.de] INFO: Found listing with ID: HJ76482
2026-03-28 07:39:40 [auto1.de] INFO: Found listing with ID: BJ31953
2026-03-28 07:39:40 [auto1.de] INFO: Found listing with ID: AT96377
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT96377%27 HTTP/1.1" 200 None
2026-03-28 07:39:40 [auto1.de] INFO: Scrape type for AT96377: 0
2026-03-28 07:39:40 [auto1.de] INFO: Found listing with ID: TW53975
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW53975%27 HTTP/1.1" 200 None
2026-03-28 07:39:40 [auto1.de] INFO: Scrape type for TW53975: 2
2026-03-28 07:39:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a63806c-a5a9-5634-b98f-a12228aa022d with identifier: TW53975
2026-03-28 07:39:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a63806c-a5a9-5634-b98f-a12228aa022d with scrape type 2
2026-03-28 07:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a63806c-a5a9-5634-b98f-a12228aa022d with scrape type 2
2026-03-28 07:39:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a63806c-a5a9-5634-b98f-a12228aa022d, identifier: TW53975
2026-03-28 07:39:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a63806c-a5a9-5634-b98f-a12228aa022d with identifier: TW53975
2026-03-28 07:39:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a63806c-a5a9-5634-b98f-a12228aa022d with identifier: TW53975
2026-03-28 07:39:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a63806c-a5a9-5634-b98f-a12228aa022d with identifier: TW53975 to the API
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:50:35Z',
'fuel_type': 'diesel',
'id': '8a63806c-a5a9-5634-b98f-a12228aa022d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW53975',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 280625,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-08',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d T 4Matic Avantgarde',
'transmission': 'automatic',
'trim': 'T 4Matic Avantgarde',
'year': 2015}
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW53975%27 HTTP/1.1" 200 None
2026-03-28 07:39:40 [auto1.de] INFO: Saving data for TW53975: {'auction_closing_time': 1774716635.0, 'created_time': 1774468088.936244, 'last_price_update_time': 1774683580.659669}
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW53975') HTTP/1.1" 204 0
2026-03-28 07:39:40 [auto1.de] INFO: Found listing with ID: KB02253
2026-03-28 07:39:40 [auto1.de] INFO: Found listing with ID: ZJ32938
2026-03-28 07:39:40 [auto1.de] INFO: Found listing with ID: ED78349
2026-03-28 07:39:40 [auto1.de] INFO: Found listing with ID: HJ62454
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ62454%27 HTTP/1.1" 200 None
2026-03-28 07:39:40 [auto1.de] INFO: Scrape type for HJ62454: 0
2026-03-28 07:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:39:41 [auto1.de] INFO: Channel: 24h | Page: 124 | totalHits: 9263 | hits on page: 40
2026-03-28 07:39:41 [auto1.de] INFO: Found listing with ID: AY57867
2026-03-28 07:39:41 [auto1.de] INFO: Found listing with ID: KC97074
2026-03-28 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC97074%27 HTTP/1.1" 200 None
2026-03-28 07:39:41 [auto1.de] INFO: Scrape type for KC97074: 0
2026-03-28 07:39:41 [auto1.de] INFO: Found listing with ID: AR60138
2026-03-28 07:39:41 [auto1.de] INFO: Found listing with ID: VR22354
2026-03-28 07:39:41 [auto1.de] INFO: Found listing with ID: BS18146
2026-03-28 07:39:41 [auto1.de] INFO: Found listing with ID: GR91976
2026-03-28 07:39:41 [auto1.de] INFO: Found listing with ID: HC32133
2026-03-28 07:39:41 [auto1.de] INFO: Found listing with ID: TG31378
2026-03-28 07:39:41 [auto1.de] INFO: Found listing with ID: RZ07739
2026-03-28 07:39:41 [auto1.de] INFO: Found listing with ID: UJ91538
2026-03-28 07:39:41 [auto1.de] INFO: Found listing with ID: CJ76479
2026-03-28 07:39:41 [auto1.de] INFO: Found listing with ID: LS64729
2026-03-28 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS64729%27 HTTP/1.1" 200 None
2026-03-28 07:39:41 [auto1.de] INFO: Scrape type for LS64729: 0
2026-03-28 07:39:41 [auto1.de] INFO: Found listing with ID: LD99689
2026-03-28 07:39:41 [auto1.de] INFO: Found listing with ID: MD90588
2026-03-28 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD90588%27 HTTP/1.1" 200 None
2026-03-28 07:39:41 [auto1.de] INFO: Scrape type for MD90588: 2
2026-03-28 07:39:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bc5bf5b-203f-56b9-8b53-97ad881395ba with identifier: MD90588
2026-03-28 07:39:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bc5bf5b-203f-56b9-8b53-97ad881395ba with scrape type 2
2026-03-28 07:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bc5bf5b-203f-56b9-8b53-97ad881395ba with scrape type 2
2026-03-28 07:39:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2bc5bf5b-203f-56b9-8b53-97ad881395ba, identifier: MD90588
2026-03-28 07:39:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2bc5bf5b-203f-56b9-8b53-97ad881395ba with identifier: MD90588
2026-03-28 07:39:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2bc5bf5b-203f-56b9-8b53-97ad881395ba with identifier: MD90588
2026-03-28 07:39:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2bc5bf5b-203f-56b9-8b53-97ad881395ba with identifier: MD90588 to the API
2026-03-28 07:39:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:00:28Z',
'fuel_type': 'petrol',
'id': '2bc5bf5b-203f-56b9-8b53-97ad881395ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD90588',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 48326,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-05',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2020}
2026-03-28 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD90588%27 HTTP/1.1" 200 None
2026-03-28 07:39:42 [auto1.de] INFO: Saving data for MD90588: {'auction_closing_time': 1774713628.0, 'created_time': 1774466582.498845, 'last_price_update_time': 1774683582.34421}
2026-03-28 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD90588') HTTP/1.1" 204 0
2026-03-28 07:39:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:39:42 [auto1.de] INFO: Found listing with ID: LN11604
2026-03-28 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN11604%27 HTTP/1.1" 200 None
2026-03-28 07:39:42 [auto1.de] INFO: Scrape type for LN11604: 0
2026-03-28 07:39:42 [auto1.de] INFO: Found listing with ID: AM47458
2026-03-28 07:39:42 [auto1.de] INFO: Found listing with ID: AP93832
2026-03-28 07:39:42 [auto1.de] INFO: Found listing with ID: WF14643
2026-03-28 07:39:42 [auto1.de] INFO: Found listing with ID: FE81350
2026-03-28 07:39:42 [auto1.de] INFO: Found listing with ID: PF91020
2026-03-28 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF91020%27 HTTP/1.1" 200 None
2026-03-28 07:39:42 [auto1.de] INFO: Scrape type for PF91020: 0
2026-03-28 07:39:42 [auto1.de] INFO: Found listing with ID: EC31076
2026-03-28 07:39:42 [auto1.de] INFO: Found listing with ID: GG35295
2026-03-28 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG35295%27 HTTP/1.1" 200 None
2026-03-28 07:39:42 [auto1.de] INFO: Scrape type for GG35295: 0
2026-03-28 07:39:42 [auto1.de] INFO: Found listing with ID: KL04932
2026-03-28 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL04932%27 HTTP/1.1" 200 None
2026-03-28 07:39:42 [auto1.de] INFO: Scrape type for KL04932: 0
2026-03-28 07:39:42 [auto1.de] INFO: Found listing with ID: ZF28173
2026-03-28 07:39:42 [auto1.de] INFO: Found listing with ID: DX07392
2026-03-28 07:39:42 [auto1.de] INFO: Found listing with ID: JZ39033
2026-03-28 07:39:42 [auto1.de] INFO: Found listing with ID: MA51695
2026-03-28 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA51695%27 HTTP/1.1" 200 None
2026-03-28 07:39:42 [auto1.de] INFO: Scrape type for MA51695: 0
2026-03-28 07:39:42 [auto1.de] INFO: Found listing with ID: AE82588
2026-03-28 07:39:42 [auto1.de] INFO: Found listing with ID: VS55791
2026-03-28 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS55791%27 HTTP/1.1" 200 None
2026-03-28 07:39:42 [auto1.de] INFO: Scrape type for VS55791: 2
2026-03-28 07:39:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7608863c-635d-5ed9-9ceb-37dd79ef84f9 with identifier: VS55791
2026-03-28 07:39:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7608863c-635d-5ed9-9ceb-37dd79ef84f9 with scrape type 2
2026-03-28 07:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7608863c-635d-5ed9-9ceb-37dd79ef84f9 with scrape type 2
2026-03-28 07:39:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7608863c-635d-5ed9-9ceb-37dd79ef84f9, identifier: VS55791
2026-03-28 07:39:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7608863c-635d-5ed9-9ceb-37dd79ef84f9 with identifier: VS55791
2026-03-28 07:39:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7608863c-635d-5ed9-9ceb-37dd79ef84f9 with identifier: VS55791
2026-03-28 07:39:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7608863c-635d-5ed9-9ceb-37dd79ef84f9 with identifier: VS55791 to the API
2026-03-28 07:39:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:55:52Z',
'fuel_type': 'petrol',
'id': '7608863c-635d-5ed9-9ceb-37dd79ef84f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS55791',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 224178,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-04-09',
'seller_name': None,
'title': 'Ford Focus 1.6 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2008}
2026-03-28 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS55791%27 HTTP/1.1" 200 None
2026-03-28 07:39:42 [auto1.de] INFO: Saving data for VS55791: {'auction_closing_time': 1774716952.0, 'created_time': 1774464574.957401, 'last_price_update_time': 1774683582.948462}
2026-03-28 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS55791') HTTP/1.1" 204 0
2026-03-28 07:39:43 [auto1.de] INFO: Found listing with ID: TC16779
2026-03-28 07:39:43 [auto1.de] INFO: Found listing with ID: NH05952
2026-03-28 07:39:43 [auto1.de] INFO: Found listing with ID: PL22285
2026-03-28 07:39:43 [auto1.de] INFO: Found listing with ID: SW58559
2026-03-28 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW58559%27 HTTP/1.1" 200 None
2026-03-28 07:39:43 [auto1.de] INFO: Scrape type for SW58559: 0
2026-03-28 07:39:43 [auto1.de] INFO: Found listing with ID: AD50252
2026-03-28 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD50252%27 HTTP/1.1" 200 None
2026-03-28 07:39:43 [auto1.de] INFO: Scrape type for AD50252: 0
2026-03-28 07:39:43 [auto1.de] INFO: Found listing with ID: ZC99377
2026-03-28 07:39:43 [auto1.de] INFO: Found listing with ID: LY07442
2026-03-28 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY07442%27 HTTP/1.1" 200 None
2026-03-28 07:39:43 [auto1.de] INFO: Scrape type for LY07442: 2
2026-03-28 07:39:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 953c8236-74a4-598a-8537-bfdce8734a1c with identifier: LY07442
2026-03-28 07:39:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 953c8236-74a4-598a-8537-bfdce8734a1c with scrape type 2
2026-03-28 07:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 953c8236-74a4-598a-8537-bfdce8734a1c with scrape type 2
2026-03-28 07:39:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 953c8236-74a4-598a-8537-bfdce8734a1c, identifier: LY07442
2026-03-28 07:39:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 953c8236-74a4-598a-8537-bfdce8734a1c with identifier: LY07442
2026-03-28 07:39:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 953c8236-74a4-598a-8537-bfdce8734a1c with identifier: LY07442
2026-03-28 07:39:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 953c8236-74a4-598a-8537-bfdce8734a1c with identifier: LY07442 to the API
2026-03-28 07:39:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-28T16:46:05Z',
'fuel_type': 'petrol',
'id': '953c8236-74a4-598a-8537-bfdce8734a1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY07442',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 7949,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-04-06',
'seller_name': None,
'title': 'Hyundai i20 1.0 TGDI Trend',
'transmission': 'automatic',
'trim': 'Trend',
'year': 2025}
2026-03-28 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY07442%27 HTTP/1.1" 200 None
2026-03-28 07:39:43 [auto1.de] INFO: Saving data for LY07442: {'auction_closing_time': 1774716365.0, 'created_time': 1774466665.605172, 'last_price_update_time': 1774683583.511934}
2026-03-28 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LY07442') HTTP/1.1" 204 0
2026-03-28 07:39:43 [auto1.de] INFO: Found listing with ID: ZH98765
2026-03-28 07:39:43 [auto1.de] INFO: Found listing with ID: HM36828
2026-03-28 07:39:43 [auto1.de] INFO: Found listing with ID: UJ86189
2026-03-28 07:39:43 [auto1.de] INFO: Found listing with ID: KX31285
2026-03-28 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX31285%27 HTTP/1.1" 200 None
2026-03-28 07:39:43 [auto1.de] INFO: Scrape type for KX31285: 0
2026-03-28 07:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:39:44 [auto1.de] INFO: Channel: 24h | Page: 125 | totalHits: 9263 | hits on page: 40
2026-03-28 07:39:44 [auto1.de] INFO: Found listing with ID: YH32466
2026-03-28 07:39:44 [auto1.de] INFO: Found listing with ID: TM05155
2026-03-28 07:39:44 [auto1.de] INFO: Found listing with ID: SH34786
2026-03-28 07:39:44 [auto1.de] INFO: Found listing with ID: GD63015
2026-03-28 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD63015%27 HTTP/1.1" 200 None
2026-03-28 07:39:44 [auto1.de] INFO: Scrape type for GD63015: 0
2026-03-28 07:39:44 [auto1.de] INFO: Found listing with ID: GK14526
2026-03-28 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK14526%27 HTTP/1.1" 200 None
2026-03-28 07:39:44 [auto1.de] INFO: Scrape type for GK14526: 0
2026-03-28 07:39:44 [auto1.de] INFO: Found listing with ID: PD23584
2026-03-28 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD23584%27 HTTP/1.1" 200 None
2026-03-28 07:39:44 [auto1.de] INFO: Scrape type for PD23584: 0
2026-03-28 07:39:44 [auto1.de] INFO: Found listing with ID: SN07258
2026-03-28 07:39:44 [auto1.de] INFO: Found listing with ID: PE56791
2026-03-28 07:39:44 [auto1.de] INFO: Found listing with ID: UE11202
2026-03-28 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE11202%27 HTTP/1.1" 200 None
2026-03-28 07:39:44 [auto1.de] INFO: Scrape type for UE11202: 0
2026-03-28 07:39:44 [auto1.de] INFO: Found listing with ID: NB64458
2026-03-28 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB64458%27 HTTP/1.1" 200 None
2026-03-28 07:39:44 [auto1.de] INFO: Scrape type for NB64458: 0
2026-03-28 07:39:44 [auto1.de] INFO: Found listing with ID: SK08799
2026-03-28 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK08799%27 HTTP/1.1" 200 None
2026-03-28 07:39:44 [auto1.de] INFO: Scrape type for SK08799: 0
2026-03-28 07:39:44 [auto1.de] INFO: Found listing with ID: BU73961
2026-03-28 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU73961%27 HTTP/1.1" 200 None
2026-03-28 07:39:44 [auto1.de] INFO: Scrape type for BU73961: 2
2026-03-28 07:39:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb240a65-a398-5de5-9195-978931d8b89d with identifier: BU73961
2026-03-28 07:39:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb240a65-a398-5de5-9195-978931d8b89d with scrape type 2
2026-03-28 07:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb240a65-a398-5de5-9195-978931d8b89d with scrape type 2
2026-03-28 07:39:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb240a65-a398-5de5-9195-978931d8b89d, identifier: BU73961
2026-03-28 07:39:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb240a65-a398-5de5-9195-978931d8b89d with identifier: BU73961
2026-03-28 07:39:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb240a65-a398-5de5-9195-978931d8b89d with identifier: BU73961
2026-03-28 07:39:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb240a65-a398-5de5-9195-978931d8b89d with identifier: BU73961 to the API
2026-03-28 07:39:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:44:31Z',
'fuel_type': 'diesel',
'id': 'eb240a65-a398-5de5-9195-978931d8b89d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU73961',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 119571,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-15',
'seller_name': None,
'title': 'Audi A6 2.0 TDI Ultra',
'transmission': 'automatic',
'trim': 'Ultra',
'year': 2017}
2026-03-28 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU73961%27 HTTP/1.1" 200 None
2026-03-28 07:39:44 [auto1.de] INFO: Saving data for BU73961: {'auction_closing_time': 1774716271.0, 'created_time': 1774031880.126452, 'last_price_update_time': 1774683584.96201}
2026-03-28 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU73961') HTTP/1.1" 204 0
2026-03-28 07:39:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: WP78953
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP78953%27 HTTP/1.1" 200 None
2026-03-28 07:39:45 [auto1.de] INFO: Scrape type for WP78953: 0
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: FP09616
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP09616%27 HTTP/1.1" 200 None
2026-03-28 07:39:45 [auto1.de] INFO: Scrape type for FP09616: 0
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: ZY67116
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: JA70507
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA70507%27 HTTP/1.1" 200 None
2026-03-28 07:39:45 [auto1.de] INFO: Scrape type for JA70507: 0
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: UJ61618
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: CZ79831
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: NP30819
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: EG42583
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG42583%27 HTTP/1.1" 200 None
2026-03-28 07:39:45 [auto1.de] INFO: Scrape type for EG42583: 2
2026-03-28 07:39:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdb17638-c6db-5ab1-88f2-d8cbc6f31164 with identifier: EG42583
2026-03-28 07:39:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdb17638-c6db-5ab1-88f2-d8cbc6f31164 with scrape type 2
2026-03-28 07:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdb17638-c6db-5ab1-88f2-d8cbc6f31164 with scrape type 2
2026-03-28 07:39:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fdb17638-c6db-5ab1-88f2-d8cbc6f31164, identifier: EG42583
2026-03-28 07:39:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fdb17638-c6db-5ab1-88f2-d8cbc6f31164 with identifier: EG42583
2026-03-28 07:39:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fdb17638-c6db-5ab1-88f2-d8cbc6f31164 with identifier: EG42583
2026-03-28 07:39:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fdb17638-c6db-5ab1-88f2-d8cbc6f31164 with identifier: EG42583 to the API
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 306,
'expiration_date': '2026-03-28T16:46:11Z',
'fuel_type': 'hybrid',
'id': 'fdb17638-c6db-5ab1-88f2-d8cbc6f31164',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG42583',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 98451,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-06',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 300 de T AMG Line',
'transmission': 'automatic',
'trim': 'T AMG Line',
'year': 2019}
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG42583%27 HTTP/1.1" 200 None
2026-03-28 07:39:45 [auto1.de] INFO: Saving data for EG42583: {'auction_closing_time': 1774716371.0, 'created_time': 1774467467.692736, 'last_price_update_time': 1774683585.535492}
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG42583') HTTP/1.1" 204 0
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: SA11397
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: FL94183
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL94183%27 HTTP/1.1" 200 None
2026-03-28 07:39:45 [auto1.de] INFO: Scrape type for FL94183: 0
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: UY48646
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: LZ58710
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: ZA01516
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA01516%27 HTTP/1.1" 200 None
2026-03-28 07:39:45 [auto1.de] INFO: Scrape type for ZA01516: 0
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: VY63466
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: SC28168
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC28168%27 HTTP/1.1" 200 None
2026-03-28 07:39:45 [auto1.de] INFO: Scrape type for SC28168: 0
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: UP16968
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: JZ87403
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: KX83133
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: LR63660
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR63660%27 HTTP/1.1" 200 None
2026-03-28 07:39:45 [auto1.de] INFO: Scrape type for LR63660: 0
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: MV80796
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV80796%27 HTTP/1.1" 200 None
2026-03-28 07:39:45 [auto1.de] INFO: Scrape type for MV80796: 0
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: GN24423
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: FV55966
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: SY31526
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: ZJ94268
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ94268%27 HTTP/1.1" 200 None
2026-03-28 07:39:45 [auto1.de] INFO: Scrape type for ZJ94268: 0
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: PZ85127
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ85127%27 HTTP/1.1" 200 None
2026-03-28 07:39:45 [auto1.de] INFO: Scrape type for PZ85127: 0
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: MF84483
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: CF68220
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF68220%27 HTTP/1.1" 200 None
2026-03-28 07:39:45 [auto1.de] INFO: Scrape type for CF68220: 0
2026-03-28 07:39:45 [auto1.de] INFO: Found listing with ID: FV82403
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV82403%27 HTTP/1.1" 200 None
2026-03-28 07:39:45 [auto1.de] INFO: Scrape type for FV82403: 0
2026-03-28 07:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:39:46 [auto1.de] INFO: Channel: 24h | Page: 126 | totalHits: 9263 | hits on page: 40
2026-03-28 07:39:46 [auto1.de] INFO: Found listing with ID: RZ33260
2026-03-28 07:39:46 [auto1.de] INFO: Found listing with ID: GF09833
2026-03-28 07:39:46 [auto1.de] INFO: Found listing with ID: JN43536
2026-03-28 07:39:46 [auto1.de] INFO: Found listing with ID: CR26660
2026-03-28 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR26660%27 HTTP/1.1" 200 None
2026-03-28 07:39:46 [auto1.de] INFO: Scrape type for CR26660: 0
2026-03-28 07:39:46 [auto1.de] INFO: Found listing with ID: WK72065
2026-03-28 07:39:46 [auto1.de] INFO: Found listing with ID: HX62286
2026-03-28 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX62286%27 HTTP/1.1" 200 None
2026-03-28 07:39:46 [auto1.de] INFO: Scrape type for HX62286: 0
2026-03-28 07:39:46 [auto1.de] INFO: Found listing with ID: TJ48176
2026-03-28 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ48176%27 HTTP/1.1" 200 None
2026-03-28 07:39:46 [auto1.de] INFO: Scrape type for TJ48176: 0
2026-03-28 07:39:46 [auto1.de] INFO: Found listing with ID: MF28588
2026-03-28 07:39:46 [auto1.de] INFO: Found listing with ID: MR37320
2026-03-28 07:39:46 [auto1.de] INFO: Found listing with ID: XH00472
2026-03-28 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH00472%27 HTTP/1.1" 200 None
2026-03-28 07:39:46 [auto1.de] INFO: Scrape type for XH00472: 0
2026-03-28 07:39:46 [auto1.de] INFO: Found listing with ID: AD85372
2026-03-28 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD85372%27 HTTP/1.1" 200 None
2026-03-28 07:39:46 [auto1.de] INFO: Scrape type for AD85372: 2
2026-03-28 07:39:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0894a9cd-f4d3-53d3-b432-4b6f77995539 with identifier: AD85372
2026-03-28 07:39:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0894a9cd-f4d3-53d3-b432-4b6f77995539 with scrape type 2
2026-03-28 07:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0894a9cd-f4d3-53d3-b432-4b6f77995539 with scrape type 2
2026-03-28 07:39:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0894a9cd-f4d3-53d3-b432-4b6f77995539, identifier: AD85372
2026-03-28 07:39:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0894a9cd-f4d3-53d3-b432-4b6f77995539 with identifier: AD85372
2026-03-28 07:39:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0894a9cd-f4d3-53d3-b432-4b6f77995539 with identifier: AD85372
2026-03-28 07:39:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0894a9cd-f4d3-53d3-b432-4b6f77995539 with identifier: AD85372 to the API
2026-03-28 07:39:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 98,
'expiration_date': '2026-03-28T16:44:27Z',
'fuel_type': 'petrol',
'id': '0894a9cd-f4d3-53d3-b432-4b6f77995539',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD85372',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 140819,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-19',
'seller_name': None,
'title': 'MINI One',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD85372%27 HTTP/1.1" 200 None
2026-03-28 07:39:47 [auto1.de] INFO: Saving data for AD85372: {'auction_closing_time': 1774716267.0, 'created_time': 1774466738.695839, 'last_price_update_time': 1774683587.134046}
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD85372') HTTP/1.1" 204 0
2026-03-28 07:39:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: JS52679
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS52679%27 HTTP/1.1" 200 None
2026-03-28 07:39:47 [auto1.de] INFO: Scrape type for JS52679: 0
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: UX22346
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX22346%27 HTTP/1.1" 200 None
2026-03-28 07:39:47 [auto1.de] INFO: Scrape type for UX22346: 0
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: PL74690
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: TA17370
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA17370%27 HTTP/1.1" 200 None
2026-03-28 07:39:47 [auto1.de] INFO: Scrape type for TA17370: 0
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: GD45566
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: WA28068
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA28068%27 HTTP/1.1" 200 None
2026-03-28 07:39:47 [auto1.de] INFO: Scrape type for WA28068: 0
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: WJ71939
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ71939%27 HTTP/1.1" 200 None
2026-03-28 07:39:47 [auto1.de] INFO: Scrape type for WJ71939: 0
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: ZW96632
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: UK33964
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK33964%27 HTTP/1.1" 200 None
2026-03-28 07:39:47 [auto1.de] INFO: Scrape type for UK33964: 0
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: JP57699
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP57699%27 HTTP/1.1" 200 None
2026-03-28 07:39:47 [auto1.de] INFO: Scrape type for JP57699: 0
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: AN22906
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: ZY13733
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: PA77354
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: YM61958
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM61958%27 HTTP/1.1" 200 None
2026-03-28 07:39:47 [auto1.de] INFO: Scrape type for YM61958: 0
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: DX36556
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX36556%27 HTTP/1.1" 200 None
2026-03-28 07:39:47 [auto1.de] INFO: Scrape type for DX36556: 0
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: RB12464
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: BX80092
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: AP30788
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: WF46634
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF46634%27 HTTP/1.1" 200 None
2026-03-28 07:39:47 [auto1.de] INFO: Scrape type for WF46634: 0
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: CV85999
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV85999%27 HTTP/1.1" 200 None
2026-03-28 07:39:47 [auto1.de] INFO: Scrape type for CV85999: 2
2026-03-28 07:39:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec088556-cd5b-5007-a746-88c65155df00 with identifier: CV85999
2026-03-28 07:39:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec088556-cd5b-5007-a746-88c65155df00 with scrape type 2
2026-03-28 07:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec088556-cd5b-5007-a746-88c65155df00 with scrape type 2
2026-03-28 07:39:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec088556-cd5b-5007-a746-88c65155df00, identifier: CV85999
2026-03-28 07:39:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec088556-cd5b-5007-a746-88c65155df00 with identifier: CV85999
2026-03-28 07:39:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec088556-cd5b-5007-a746-88c65155df00 with identifier: CV85999
2026-03-28 07:39:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec088556-cd5b-5007-a746-88c65155df00 with identifier: CV85999 to the API
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:49:06Z',
'fuel_type': 'petrol',
'id': 'ec088556-cd5b-5007-a746-88c65155df00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV85999',
'listing': 'auction',
'make': 'MINI',
'model': 'Clubman',
'odometer': 73170,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-16',
'seller_name': None,
'title': 'MINI Clubman One',
'transmission': 'manual',
'trim': '',
'year': 2018}
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV85999%27 HTTP/1.1" 200 None
2026-03-28 07:39:47 [auto1.de] INFO: Saving data for CV85999: {'auction_closing_time': 1774716546.0, 'created_time': 1774467249.652989, 'last_price_update_time': 1774683587.856829}
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV85999') HTTP/1.1" 204 0
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: AD16750
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: KN60852
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: VB96858
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: UH63993
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: LF01905
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF01905%27 HTTP/1.1" 200 None
2026-03-28 07:39:47 [auto1.de] INFO: Scrape type for LF01905: 0
2026-03-28 07:39:47 [auto1.de] INFO: Found listing with ID: WM09546
2026-03-28 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM09546%27 HTTP/1.1" 200 None
2026-03-28 07:39:48 [auto1.de] INFO: Scrape type for WM09546: 0
2026-03-28 07:39:48 [auto1.de] INFO: Found listing with ID: XY85080
2026-03-28 07:39:48 [auto1.de] INFO: Found listing with ID: PA63751
2026-03-28 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA63751%27 HTTP/1.1" 200 None
2026-03-28 07:39:48 [auto1.de] INFO: Scrape type for PA63751: 0
2026-03-28 07:39:48 [auto1.de] INFO: Found listing with ID: SZ20941
2026-03-28 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ20941%27 HTTP/1.1" 200 None
2026-03-28 07:39:48 [auto1.de] INFO: Scrape type for SZ20941: 0
2026-03-28 07:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:39:49 [auto1.de] INFO: Channel: 24h | Page: 127 | totalHits: 9263 | hits on page: 40
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: VH67229
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH67229%27 HTTP/1.1" 200 None
2026-03-28 07:39:49 [auto1.de] INFO: Scrape type for VH67229: 0
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: AW32080
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: FT09783
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT09783%27 HTTP/1.1" 200 None
2026-03-28 07:39:49 [auto1.de] INFO: Scrape type for FT09783: 0
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: HC78210
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC78210%27 HTTP/1.1" 200 None
2026-03-28 07:39:49 [auto1.de] INFO: Scrape type for HC78210: 0
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: PP42616
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: WB92909
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB92909%27 HTTP/1.1" 200 None
2026-03-28 07:39:49 [auto1.de] INFO: Scrape type for WB92909: 0
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: RP99262
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: FH63073
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH63073%27 HTTP/1.1" 200 None
2026-03-28 07:39:49 [auto1.de] INFO: Scrape type for FH63073: 0
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: DH60406
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH60406%27 HTTP/1.1" 200 None
2026-03-28 07:39:49 [auto1.de] INFO: Scrape type for DH60406: 0
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: TK34912
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK34912%27 HTTP/1.1" 200 None
2026-03-28 07:39:49 [auto1.de] INFO: Scrape type for TK34912: 0
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: RY11817
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY11817%27 HTTP/1.1" 200 None
2026-03-28 07:39:49 [auto1.de] INFO: Scrape type for RY11817: 0
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: LZ76677
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: VS20151
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS20151%27 HTTP/1.1" 200 None
2026-03-28 07:39:49 [auto1.de] INFO: Scrape type for VS20151: 0
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: YJ21289
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: MA95783
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA95783%27 HTTP/1.1" 200 None
2026-03-28 07:39:49 [auto1.de] INFO: Scrape type for MA95783: 0
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: KZ31354
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: EW67341
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW67341%27 HTTP/1.1" 200 None
2026-03-28 07:39:49 [auto1.de] INFO: Scrape type for EW67341: 0
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: GW17934
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: AC08857
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC08857%27 HTTP/1.1" 200 None
2026-03-28 07:39:49 [auto1.de] INFO: Scrape type for AC08857: 0
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: JC28332
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: KR13539
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: WJ75594
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: TY90085
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY90085%27 HTTP/1.1" 200 None
2026-03-28 07:39:49 [auto1.de] INFO: Scrape type for TY90085: 0
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: SM94434
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: AJ01843
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ01843%27 HTTP/1.1" 200 None
2026-03-28 07:39:49 [auto1.de] INFO: Scrape type for AJ01843: 0
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: PY95410
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: PY88253
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: RT92200
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: XF50561
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: LT54057
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT54057%27 HTTP/1.1" 200 None
2026-03-28 07:39:49 [auto1.de] INFO: Scrape type for LT54057: 0
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: HU45094
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU45094%27 HTTP/1.1" 200 None
2026-03-28 07:39:49 [auto1.de] INFO: Scrape type for HU45094: 0
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: PR75210
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR75210%27 HTTP/1.1" 200 None
2026-03-28 07:39:49 [auto1.de] INFO: Scrape type for PR75210: 0
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: UP37190
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP37190%27 HTTP/1.1" 200 None
2026-03-28 07:39:49 [auto1.de] INFO: Scrape type for UP37190: 0
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: YR65508
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR65508%27 HTTP/1.1" 200 None
2026-03-28 07:39:49 [auto1.de] INFO: Scrape type for YR65508: 0
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: RT09280
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT09280%27 HTTP/1.1" 200 None
2026-03-28 07:39:49 [auto1.de] INFO: Scrape type for RT09280: 0
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: WB32004
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: BM72646
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: JW05714
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW05714%27 HTTP/1.1" 200 None
2026-03-28 07:39:49 [auto1.de] INFO: Scrape type for JW05714: 0
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: BS29922
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS29922%27 HTTP/1.1" 200 None
2026-03-28 07:39:49 [auto1.de] INFO: Scrape type for BS29922: 0
2026-03-28 07:39:49 [auto1.de] INFO: Found listing with ID: JE98088
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE98088%27 HTTP/1.1" 200 None
2026-03-28 07:39:49 [auto1.de] INFO: Scrape type for JE98088: 0
2026-03-28 07:39:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:39:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:39:50 [auto1.de] INFO: Channel: 24h | Page: 128 | totalHits: 9263 | hits on page: 40
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: LN53329
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: UC69607
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: WF16745
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: JR87294
2026-03-28 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR87294%27 HTTP/1.1" 200 None
2026-03-28 07:39:50 [auto1.de] INFO: Scrape type for JR87294: 0
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: YT16103
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: JN34556
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: BC71264
2026-03-28 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC71264%27 HTTP/1.1" 200 None
2026-03-28 07:39:50 [auto1.de] INFO: Scrape type for BC71264: 0
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: DB54386
2026-03-28 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB54386%27 HTTP/1.1" 200 None
2026-03-28 07:39:50 [auto1.de] INFO: Scrape type for DB54386: 0
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: DE70516
2026-03-28 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE70516%27 HTTP/1.1" 200 None
2026-03-28 07:39:50 [auto1.de] INFO: Scrape type for DE70516: 0
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: AN12831
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: EL83398
2026-03-28 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL83398%27 HTTP/1.1" 200 None
2026-03-28 07:39:50 [auto1.de] INFO: Scrape type for EL83398: 0
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: XE96364
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: FG57535
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: GN29704
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: WH80890
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: DP55195
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: KZ71348
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: ZW43695
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: TK89986
2026-03-28 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK89986%27 HTTP/1.1" 200 None
2026-03-28 07:39:50 [auto1.de] INFO: Scrape type for TK89986: 0
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: EH98635
2026-03-28 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH98635%27 HTTP/1.1" 200 None
2026-03-28 07:39:50 [auto1.de] INFO: Scrape type for EH98635: 0
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: DY62455
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: CS42122
2026-03-28 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS42122%27 HTTP/1.1" 200 None
2026-03-28 07:39:50 [auto1.de] INFO: Scrape type for CS42122: 0
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: VU26038
2026-03-28 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU26038%27 HTTP/1.1" 200 None
2026-03-28 07:39:50 [auto1.de] INFO: Scrape type for VU26038: 0
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: ZC46474
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: FH83727
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: XR30933
2026-03-28 07:39:50 [auto1.de] INFO: Found listing with ID: FZ97744
2026-03-28 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ97744%27 HTTP/1.1" 200 None
2026-03-28 07:39:50 [auto1.de] INFO: Scrape type for FZ97744: 2
2026-03-28 07:39:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 636bdda8-9e4a-5f30-8bb2-a46199860cd9 with identifier: FZ97744
2026-03-28 07:39:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 636bdda8-9e4a-5f30-8bb2-a46199860cd9 with scrape type 2
2026-03-28 07:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 636bdda8-9e4a-5f30-8bb2-a46199860cd9 with scrape type 2
2026-03-28 07:39:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 636bdda8-9e4a-5f30-8bb2-a46199860cd9, identifier: FZ97744
2026-03-28 07:39:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 636bdda8-9e4a-5f30-8bb2-a46199860cd9 with identifier: FZ97744
2026-03-28 07:39:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 636bdda8-9e4a-5f30-8bb2-a46199860cd9 with identifier: FZ97744
2026-03-28 07:39:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 636bdda8-9e4a-5f30-8bb2-a46199860cd9 with identifier: FZ97744 to the API
2026-03-28 07:39:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:17:46Z',
'fuel_type': 'petrol',
'id': '636bdda8-9e4a-5f30-8bb2-a46199860cd9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ97744',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 127423,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-14',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Lounge BlueMotion Tech.',
'transmission': 'automatic',
'trim': 'Lounge BlueMotion Tech.',
'year': 2016}
2026-03-28 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ97744%27 HTTP/1.1" 200 None
2026-03-28 07:39:51 [auto1.de] INFO: Saving data for FZ97744: {'auction_closing_time': 1774714666.0, 'created_time': 1774466194.442915, 'last_price_update_time': 1774683591.143893}
2026-03-28 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ97744') HTTP/1.1" 204 0
2026-03-28 07:39:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:39:51 [auto1.de] INFO: Found listing with ID: KY24056
2026-03-28 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY24056%27 HTTP/1.1" 200 None
2026-03-28 07:39:51 [auto1.de] INFO: Scrape type for KY24056: 0
2026-03-28 07:39:51 [auto1.de] INFO: Found listing with ID: FU42762
2026-03-28 07:39:51 [auto1.de] INFO: Found listing with ID: GK88230
2026-03-28 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK88230%27 HTTP/1.1" 200 None
2026-03-28 07:39:51 [auto1.de] INFO: Scrape type for GK88230: 0
2026-03-28 07:39:51 [auto1.de] INFO: Found listing with ID: NX65869
2026-03-28 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX65869%27 HTTP/1.1" 200 None
2026-03-28 07:39:51 [auto1.de] INFO: Scrape type for NX65869: 0
2026-03-28 07:39:51 [auto1.de] INFO: Found listing with ID: NV55491
2026-03-28 07:39:51 [auto1.de] INFO: Found listing with ID: YF52750
2026-03-28 07:39:51 [auto1.de] INFO: Found listing with ID: HX03519
2026-03-28 07:39:51 [auto1.de] INFO: Found listing with ID: UZ16181
2026-03-28 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ16181%27 HTTP/1.1" 200 None
2026-03-28 07:39:51 [auto1.de] INFO: Scrape type for UZ16181: 2
2026-03-28 07:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d8e0438-ee60-5c51-afd0-37f426cfb2ac with identifier: UZ16181
2026-03-28 07:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d8e0438-ee60-5c51-afd0-37f426cfb2ac with scrape type 2
2026-03-28 07:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d8e0438-ee60-5c51-afd0-37f426cfb2ac with scrape type 2
2026-03-28 07:39:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d8e0438-ee60-5c51-afd0-37f426cfb2ac, identifier: UZ16181
2026-03-28 07:39:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d8e0438-ee60-5c51-afd0-37f426cfb2ac with identifier: UZ16181
2026-03-28 07:39:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d8e0438-ee60-5c51-afd0-37f426cfb2ac with identifier: UZ16181
2026-03-28 07:39:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d8e0438-ee60-5c51-afd0-37f426cfb2ac with identifier: UZ16181 to the API
2026-03-28 07:39:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:14:45Z',
'fuel_type': 'petrol',
'id': '6d8e0438-ee60-5c51-afd0-37f426cfb2ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ16181',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 113172,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-19',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2013}
2026-03-28 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ16181%27 HTTP/1.1" 200 None
2026-03-28 07:39:51 [auto1.de] INFO: Saving data for UZ16181: {'auction_closing_time': 1774714485.0, 'created_time': 1774463821.758048, 'last_price_update_time': 1774683591.751047}
2026-03-28 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ16181') HTTP/1.1" 204 0
2026-03-28 07:39:51 [auto1.de] INFO: Found listing with ID: MS62719
2026-03-28 07:39:51 [auto1.de] INFO: Found listing with ID: TW80485
2026-03-28 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW80485%27 HTTP/1.1" 200 None
2026-03-28 07:39:51 [auto1.de] INFO: Scrape type for TW80485: 0
2026-03-28 07:39:51 [auto1.de] INFO: Found listing with ID: TB37654
2026-03-28 07:39:51 [auto1.de] INFO: Found listing with ID: SR67538
2026-03-28 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR67538%27 HTTP/1.1" 200 None
2026-03-28 07:39:51 [auto1.de] INFO: Scrape type for SR67538: 0
2026-03-28 07:39:51 [auto1.de] INFO: Found listing with ID: JR27484
2026-03-28 07:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:39:52 [auto1.de] INFO: Channel: 24h | Page: 129 | totalHits: 9263 | hits on page: 40
2026-03-28 07:39:52 [auto1.de] INFO: Found listing with ID: EX94695
2026-03-28 07:39:52 [auto1.de] INFO: Found listing with ID: PN20097
2026-03-28 07:39:52 [auto1.de] INFO: Found listing with ID: UA31862
2026-03-28 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA31862%27 HTTP/1.1" 200 None
2026-03-28 07:39:52 [auto1.de] INFO: Scrape type for UA31862: 0
2026-03-28 07:39:52 [auto1.de] INFO: Found listing with ID: FP87912
2026-03-28 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP87912%27 HTTP/1.1" 200 None
2026-03-28 07:39:52 [auto1.de] INFO: Scrape type for FP87912: 0
2026-03-28 07:39:52 [auto1.de] INFO: Found listing with ID: JF93037
2026-03-28 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF93037%27 HTTP/1.1" 200 None
2026-03-28 07:39:52 [auto1.de] INFO: Scrape type for JF93037: 0
2026-03-28 07:39:52 [auto1.de] INFO: Found listing with ID: VJ44121
2026-03-28 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ44121%27 HTTP/1.1" 200 None
2026-03-28 07:39:52 [auto1.de] INFO: Scrape type for VJ44121: 0
2026-03-28 07:39:52 [auto1.de] INFO: Found listing with ID: LY36770
2026-03-28 07:39:52 [auto1.de] INFO: Found listing with ID: KS41685
2026-03-28 07:39:52 [auto1.de] INFO: Found listing with ID: HA91024
2026-03-28 07:39:52 [auto1.de] INFO: Found listing with ID: ZZ69098
2026-03-28 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ69098%27 HTTP/1.1" 200 None
2026-03-28 07:39:52 [auto1.de] INFO: Scrape type for ZZ69098: 0
2026-03-28 07:39:52 [auto1.de] INFO: Found listing with ID: EC36111
2026-03-28 07:39:52 [auto1.de] INFO: Found listing with ID: DR00758
2026-03-28 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR00758%27 HTTP/1.1" 200 None
2026-03-28 07:39:52 [auto1.de] INFO: Scrape type for DR00758: 0
2026-03-28 07:39:52 [auto1.de] INFO: Found listing with ID: XK53444
2026-03-28 07:39:52 [auto1.de] INFO: Found listing with ID: ZK88504
2026-03-28 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK88504%27 HTTP/1.1" 200 None
2026-03-28 07:39:52 [auto1.de] INFO: Scrape type for ZK88504: 0
2026-03-28 07:39:52 [auto1.de] INFO: Found listing with ID: UB87978
2026-03-28 07:39:52 [auto1.de] INFO: Found listing with ID: DU95569
2026-03-28 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU95569%27 HTTP/1.1" 200 None
2026-03-28 07:39:52 [auto1.de] INFO: Scrape type for DU95569: 2
2026-03-28 07:39:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 974d8578-4bbc-5dfa-a13e-f6963188f90a with identifier: DU95569
2026-03-28 07:39:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 974d8578-4bbc-5dfa-a13e-f6963188f90a with scrape type 2
2026-03-28 07:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 974d8578-4bbc-5dfa-a13e-f6963188f90a with scrape type 2
2026-03-28 07:39:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 974d8578-4bbc-5dfa-a13e-f6963188f90a, identifier: DU95569
2026-03-28 07:39:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 974d8578-4bbc-5dfa-a13e-f6963188f90a with identifier: DU95569
2026-03-28 07:39:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 974d8578-4bbc-5dfa-a13e-f6963188f90a with identifier: DU95569
2026-03-28 07:39:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 974d8578-4bbc-5dfa-a13e-f6963188f90a with identifier: DU95569 to the API
2026-03-28 07:39:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:12:52Z',
'fuel_type': 'diesel',
'id': '974d8578-4bbc-5dfa-a13e-f6963188f90a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU95569',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 152869,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-11',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI RS',
'transmission': 'automatic',
'trim': 'RS',
'year': 2017}
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU95569%27 HTTP/1.1" 200 None
2026-03-28 07:39:53 [auto1.de] INFO: Saving data for DU95569: {'auction_closing_time': 1774714372.0, 'created_time': 1773829835.765798, 'last_price_update_time': 1774683593.159763}
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU95569') HTTP/1.1" 204 0
2026-03-28 07:39:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:39:53 [auto1.de] INFO: Found listing with ID: WC00237
2026-03-28 07:39:53 [auto1.de] INFO: Found listing with ID: JE86051
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE86051%27 HTTP/1.1" 200 None
2026-03-28 07:39:53 [auto1.de] INFO: Scrape type for JE86051: 0
2026-03-28 07:39:53 [auto1.de] INFO: Found listing with ID: YL83790
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL83790%27 HTTP/1.1" 200 None
2026-03-28 07:39:53 [auto1.de] INFO: Scrape type for YL83790: 0
2026-03-28 07:39:53 [auto1.de] INFO: Found listing with ID: YF79248
2026-03-28 07:39:53 [auto1.de] INFO: Found listing with ID: TA53494
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA53494%27 HTTP/1.1" 200 None
2026-03-28 07:39:53 [auto1.de] INFO: Scrape type for TA53494: 0
2026-03-28 07:39:53 [auto1.de] INFO: Found listing with ID: MC25913
2026-03-28 07:39:53 [auto1.de] INFO: Found listing with ID: NP13175
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP13175%27 HTTP/1.1" 200 None
2026-03-28 07:39:53 [auto1.de] INFO: Scrape type for NP13175: 0
2026-03-28 07:39:53 [auto1.de] INFO: Found listing with ID: KS63717
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS63717%27 HTTP/1.1" 200 None
2026-03-28 07:39:53 [auto1.de] INFO: Scrape type for KS63717: 0
2026-03-28 07:39:53 [auto1.de] INFO: Found listing with ID: FT98608
2026-03-28 07:39:53 [auto1.de] INFO: Found listing with ID: GA14949
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA14949%27 HTTP/1.1" 200 None
2026-03-28 07:39:53 [auto1.de] INFO: Scrape type for GA14949: 0
2026-03-28 07:39:53 [auto1.de] INFO: Found listing with ID: JG20363
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG20363%27 HTTP/1.1" 200 None
2026-03-28 07:39:53 [auto1.de] INFO: Scrape type for JG20363: 0
2026-03-28 07:39:53 [auto1.de] INFO: Found listing with ID: KD43899
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD43899%27 HTTP/1.1" 200 None
2026-03-28 07:39:53 [auto1.de] INFO: Scrape type for KD43899: 0
2026-03-28 07:39:53 [auto1.de] INFO: Found listing with ID: NU10771
2026-03-28 07:39:53 [auto1.de] INFO: Found listing with ID: XL21584
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL21584%27 HTTP/1.1" 200 None
2026-03-28 07:39:53 [auto1.de] INFO: Scrape type for XL21584: 0
2026-03-28 07:39:53 [auto1.de] INFO: Found listing with ID: DX08468
2026-03-28 07:39:53 [auto1.de] INFO: Found listing with ID: XK58974
2026-03-28 07:39:53 [auto1.de] INFO: Found listing with ID: BV38290
2026-03-28 07:39:53 [auto1.de] INFO: Found listing with ID: XV42513
2026-03-28 07:39:53 [auto1.de] INFO: Found listing with ID: DP39358
2026-03-28 07:39:53 [auto1.de] INFO: Found listing with ID: TJ48727
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ48727%27 HTTP/1.1" 200 None
2026-03-28 07:39:53 [auto1.de] INFO: Scrape type for TJ48727: 2
2026-03-28 07:39:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89719389-bb37-5eb6-a8c9-7cc742beb150 with identifier: TJ48727
2026-03-28 07:39:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89719389-bb37-5eb6-a8c9-7cc742beb150 with scrape type 2
2026-03-28 07:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89719389-bb37-5eb6-a8c9-7cc742beb150 with scrape type 2
2026-03-28 07:39:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89719389-bb37-5eb6-a8c9-7cc742beb150, identifier: TJ48727
2026-03-28 07:39:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89719389-bb37-5eb6-a8c9-7cc742beb150 with identifier: TJ48727
2026-03-28 07:39:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89719389-bb37-5eb6-a8c9-7cc742beb150 with identifier: TJ48727
2026-03-28 07:39:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89719389-bb37-5eb6-a8c9-7cc742beb150 with identifier: TJ48727 to the API
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:54:57Z',
'fuel_type': 'petrol',
'id': '89719389-bb37-5eb6-a8c9-7cc742beb150',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ48727',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 134838,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-18',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 200 T 4Matic AMG Line',
'transmission': 'automatic',
'trim': 'T 4Matic AMG Line',
'year': 2018}
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ48727%27 HTTP/1.1" 200 None
2026-03-28 07:39:53 [auto1.de] INFO: Saving data for TJ48727: {'auction_closing_time': 1774716897.0, 'created_time': 1774465891.673104, 'last_price_update_time': 1774683593.825381}
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ48727') HTTP/1.1" 204 0
2026-03-28 07:39:53 [auto1.de] INFO: Found listing with ID: US71241
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US71241%27 HTTP/1.1" 200 None
2026-03-28 07:39:53 [auto1.de] INFO: Scrape type for US71241: 0
2026-03-28 07:39:53 [auto1.de] INFO: Found listing with ID: RT49576
2026-03-28 07:39:53 [auto1.de] INFO: Found listing with ID: TJ52961
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ52961%27 HTTP/1.1" 200 None
2026-03-28 07:39:53 [auto1.de] INFO: Scrape type for TJ52961: 0
2026-03-28 07:39:53 [auto1.de] INFO: Found listing with ID: XF10018
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF10018%27 HTTP/1.1" 200 None
2026-03-28 07:39:53 [auto1.de] INFO: Scrape type for XF10018: 0
2026-03-28 07:39:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:39:55 [auto1.de] INFO: Channel: 24h | Page: 130 | totalHits: 9263 | hits on page: 40
2026-03-28 07:39:55 [auto1.de] INFO: Found listing with ID: LH00123
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH00123%27 HTTP/1.1" 200 None
2026-03-28 07:39:55 [auto1.de] INFO: Scrape type for LH00123: 0
2026-03-28 07:39:55 [auto1.de] INFO: Found listing with ID: KT21278
2026-03-28 07:39:55 [auto1.de] INFO: Found listing with ID: GX30612
2026-03-28 07:39:55 [auto1.de] INFO: Found listing with ID: WV66360
2026-03-28 07:39:55 [auto1.de] INFO: Found listing with ID: DK15420
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK15420%27 HTTP/1.1" 200 None
2026-03-28 07:39:55 [auto1.de] INFO: Scrape type for DK15420: 2
2026-03-28 07:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 519663ca-d567-56dc-9872-5ea272ef45b4 with identifier: DK15420
2026-03-28 07:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 519663ca-d567-56dc-9872-5ea272ef45b4 with scrape type 2
2026-03-28 07:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 519663ca-d567-56dc-9872-5ea272ef45b4 with scrape type 2
2026-03-28 07:39:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 519663ca-d567-56dc-9872-5ea272ef45b4, identifier: DK15420
2026-03-28 07:39:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 519663ca-d567-56dc-9872-5ea272ef45b4 with identifier: DK15420
2026-03-28 07:39:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 519663ca-d567-56dc-9872-5ea272ef45b4 with identifier: DK15420
2026-03-28 07:39:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 519663ca-d567-56dc-9872-5ea272ef45b4 with identifier: DK15420 to the API
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 333,
'expiration_date': '2026-03-28T16:26:32Z',
'fuel_type': 'petrol',
'id': '519663ca-d567-56dc-9872-5ea272ef45b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK15420',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 203884,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-04',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 400 T 4Matic AMG Line',
'transmission': 'automatic',
'trim': 'T 4Matic AMG Line',
'year': 2019}
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK15420%27 HTTP/1.1" 200 None
2026-03-28 07:39:55 [auto1.de] INFO: Saving data for DK15420: {'auction_closing_time': 1774715192.0, 'created_time': 1774468004.984937, 'last_price_update_time': 1774683595.465728}
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK15420') HTTP/1.1" 204 0
2026-03-28 07:39:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:39:55 [auto1.de] INFO: Found listing with ID: FV50908
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV50908%27 HTTP/1.1" 200 None
2026-03-28 07:39:55 [auto1.de] INFO: Scrape type for FV50908: 0
2026-03-28 07:39:55 [auto1.de] INFO: Found listing with ID: HP20518
2026-03-28 07:39:55 [auto1.de] INFO: Found listing with ID: ND74491
2026-03-28 07:39:55 [auto1.de] INFO: Found listing with ID: ZM65960
2026-03-28 07:39:55 [auto1.de] INFO: Found listing with ID: WW30672
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW30672%27 HTTP/1.1" 200 None
2026-03-28 07:39:55 [auto1.de] INFO: Scrape type for WW30672: 0
2026-03-28 07:39:55 [auto1.de] INFO: Found listing with ID: BM70881
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM70881%27 HTTP/1.1" 200 None
2026-03-28 07:39:55 [auto1.de] INFO: Scrape type for BM70881: 0
2026-03-28 07:39:55 [auto1.de] INFO: Found listing with ID: VH10251
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH10251%27 HTTP/1.1" 200 None
2026-03-28 07:39:55 [auto1.de] INFO: Scrape type for VH10251: 0
2026-03-28 07:39:55 [auto1.de] INFO: Found listing with ID: YV13376
2026-03-28 07:39:55 [auto1.de] INFO: Found listing with ID: NR78945
2026-03-28 07:39:55 [auto1.de] INFO: Found listing with ID: NC53020
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC53020%27 HTTP/1.1" 200 None
2026-03-28 07:39:55 [auto1.de] INFO: Scrape type for NC53020: 0
2026-03-28 07:39:55 [auto1.de] INFO: Found listing with ID: TF56080
2026-03-28 07:39:55 [auto1.de] INFO: Found listing with ID: CB60323
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB60323%27 HTTP/1.1" 200 None
2026-03-28 07:39:55 [auto1.de] INFO: Scrape type for CB60323: 2
2026-03-28 07:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33c09731-fc2b-5f9a-b171-37f46f390be9 with identifier: CB60323
2026-03-28 07:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33c09731-fc2b-5f9a-b171-37f46f390be9 with scrape type 2
2026-03-28 07:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33c09731-fc2b-5f9a-b171-37f46f390be9 with scrape type 2
2026-03-28 07:39:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33c09731-fc2b-5f9a-b171-37f46f390be9, identifier: CB60323
2026-03-28 07:39:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33c09731-fc2b-5f9a-b171-37f46f390be9 with identifier: CB60323
2026-03-28 07:39:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33c09731-fc2b-5f9a-b171-37f46f390be9 with identifier: CB60323
2026-03-28 07:39:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33c09731-fc2b-5f9a-b171-37f46f390be9 with identifier: CB60323 to the API
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 155,
'expiration_date': '2026-03-28T16:56:01Z',
'fuel_type': 'petrol',
'id': '33c09731-fc2b-5f9a-b171-37f46f390be9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB60323',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 187127,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-29',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 Kompressor Avantgarde',
'transmission': 'manual',
'trim': 'Avantgarde',
'year': 2009}
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB60323%27 HTTP/1.1" 200 None
2026-03-28 07:39:55 [auto1.de] INFO: Saving data for CB60323: {'auction_closing_time': 1774716961.0, 'created_time': 1774466432.289827, 'last_price_update_time': 1774683595.983763}
2026-03-28 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CB60323') HTTP/1.1" 204 0
2026-03-28 07:39:56 [auto1.de] INFO: Found listing with ID: YN95759
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN95759%27 HTTP/1.1" 200 None
2026-03-28 07:39:56 [auto1.de] INFO: Scrape type for YN95759: 0
2026-03-28 07:39:56 [auto1.de] INFO: Found listing with ID: DB69488
2026-03-28 07:39:56 [auto1.de] INFO: Found listing with ID: CL04690
2026-03-28 07:39:56 [auto1.de] INFO: Found listing with ID: FY34771
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY34771%27 HTTP/1.1" 200 None
2026-03-28 07:39:56 [auto1.de] INFO: Scrape type for FY34771: 0
2026-03-28 07:39:56 [auto1.de] INFO: Found listing with ID: YF83541
2026-03-28 07:39:56 [auto1.de] INFO: Found listing with ID: AW34840
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW34840%27 HTTP/1.1" 200 None
2026-03-28 07:39:56 [auto1.de] INFO: Scrape type for AW34840: 0
2026-03-28 07:39:56 [auto1.de] INFO: Found listing with ID: AP83246
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP83246%27 HTTP/1.1" 200 None
2026-03-28 07:39:56 [auto1.de] INFO: Scrape type for AP83246: 0
2026-03-28 07:39:56 [auto1.de] INFO: Found listing with ID: FP32439
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP32439%27 HTTP/1.1" 200 None
2026-03-28 07:39:56 [auto1.de] INFO: Scrape type for FP32439: 2
2026-03-28 07:39:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: debf0902-9082-59c4-a4e9-e2a3aeb5e69c with identifier: FP32439
2026-03-28 07:39:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item debf0902-9082-59c4-a4e9-e2a3aeb5e69c with scrape type 2
2026-03-28 07:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item debf0902-9082-59c4-a4e9-e2a3aeb5e69c with scrape type 2
2026-03-28 07:39:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: debf0902-9082-59c4-a4e9-e2a3aeb5e69c, identifier: FP32439
2026-03-28 07:39:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: debf0902-9082-59c4-a4e9-e2a3aeb5e69c with identifier: FP32439
2026-03-28 07:39:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: debf0902-9082-59c4-a4e9-e2a3aeb5e69c with identifier: FP32439
2026-03-28 07:39:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: debf0902-9082-59c4-a4e9-e2a3aeb5e69c with identifier: FP32439 to the API
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:22:44Z',
'fuel_type': 'petrol',
'id': 'debf0902-9082-59c4-a4e9-e2a3aeb5e69c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP32439',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 157910,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-10',
'seller_name': None,
'title': 'Audi A6 2.8 V6 FSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2012}
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP32439%27 HTTP/1.1" 200 None
2026-03-28 07:39:56 [auto1.de] INFO: Saving data for FP32439: {'auction_closing_time': 1774714964.0, 'created_time': 1773946201.413967, 'last_price_update_time': 1774683596.559644}
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP32439') HTTP/1.1" 204 0
2026-03-28 07:39:56 [auto1.de] INFO: Found listing with ID: EB43981
2026-03-28 07:39:56 [auto1.de] INFO: Found listing with ID: AM22108
2026-03-28 07:39:56 [auto1.de] INFO: Found listing with ID: YF37634
2026-03-28 07:39:56 [auto1.de] INFO: Found listing with ID: YZ97143
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ97143%27 HTTP/1.1" 200 None
2026-03-28 07:39:56 [auto1.de] INFO: Scrape type for YZ97143: 0
2026-03-28 07:39:56 [auto1.de] INFO: Found listing with ID: XE27570
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE27570%27 HTTP/1.1" 200 None
2026-03-28 07:39:56 [auto1.de] INFO: Scrape type for XE27570: 0
2026-03-28 07:39:56 [auto1.de] INFO: Found listing with ID: KR20197
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR20197%27 HTTP/1.1" 200 None
2026-03-28 07:39:56 [auto1.de] INFO: Scrape type for KR20197: 0
2026-03-28 07:39:56 [auto1.de] INFO: Found listing with ID: VZ67143
2026-03-28 07:39:56 [auto1.de] INFO: Found listing with ID: PY29315
2026-03-28 07:39:56 [auto1.de] INFO: Found listing with ID: TV42528
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV42528%27 HTTP/1.1" 200 None
2026-03-28 07:39:56 [auto1.de] INFO: Scrape type for TV42528: 0
2026-03-28 07:39:56 [auto1.de] INFO: Found listing with ID: WV18755
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV18755%27 HTTP/1.1" 200 None
2026-03-28 07:39:56 [auto1.de] INFO: Scrape type for WV18755: 0
2026-03-28 07:39:56 [auto1.de] INFO: Found listing with ID: FT81619
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT81619%27 HTTP/1.1" 200 None
2026-03-28 07:39:56 [auto1.de] INFO: Scrape type for FT81619: 0
2026-03-28 07:39:56 [auto1.de] INFO: Found listing with ID: HX10510
2026-03-28 07:39:56 [auto1.de] INFO: Found listing with ID: RA28898
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA28898%27 HTTP/1.1" 200 None
2026-03-28 07:39:56 [auto1.de] INFO: Scrape type for RA28898: 0
2026-03-28 07:39:56 [auto1.de] INFO: Found listing with ID: BW09320
2026-03-28 07:39:56 [auto1.de] INFO: Found listing with ID: DN55210
2026-03-28 07:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:39:57 [auto1.de] INFO: Channel: 24h | Page: 131 | totalHits: 9263 | hits on page: 40
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: AM19734
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM19734%27 HTTP/1.1" 200 None
2026-03-28 07:39:57 [auto1.de] INFO: Scrape type for AM19734: 0
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: CJ14653
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ14653%27 HTTP/1.1" 200 None
2026-03-28 07:39:57 [auto1.de] INFO: Scrape type for CJ14653: 0
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: WY54467
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: EF17850
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: GE87881
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE87881%27 HTTP/1.1" 200 None
2026-03-28 07:39:57 [auto1.de] INFO: Scrape type for GE87881: 0
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: YK91002
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: EG62319
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: PF20752
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF20752%27 HTTP/1.1" 200 None
2026-03-28 07:39:57 [auto1.de] INFO: Scrape type for PF20752: 0
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: NZ55073
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ55073%27 HTTP/1.1" 200 None
2026-03-28 07:39:57 [auto1.de] INFO: Scrape type for NZ55073: 0
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: GU28409
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU28409%27 HTTP/1.1" 200 None
2026-03-28 07:39:57 [auto1.de] INFO: Scrape type for GU28409: 0
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: UU71497
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: ZX84028
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX84028%27 HTTP/1.1" 200 None
2026-03-28 07:39:57 [auto1.de] INFO: Scrape type for ZX84028: 0
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: DH94169
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH94169%27 HTTP/1.1" 200 None
2026-03-28 07:39:57 [auto1.de] INFO: Scrape type for DH94169: 0
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: KF03787
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: SB57558
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB57558%27 HTTP/1.1" 200 None
2026-03-28 07:39:57 [auto1.de] INFO: Scrape type for SB57558: 0
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: HB59808
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: GP04602
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP04602%27 HTTP/1.1" 200 None
2026-03-28 07:39:57 [auto1.de] INFO: Scrape type for GP04602: 0
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: AT78165
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: DR78688
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR78688%27 HTTP/1.1" 200 None
2026-03-28 07:39:57 [auto1.de] INFO: Scrape type for DR78688: 0
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: ML80867
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: BY66745
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY66745%27 HTTP/1.1" 200 None
2026-03-28 07:39:57 [auto1.de] INFO: Scrape type for BY66745: 0
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: ZD20982
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: GP35635
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: SC87676
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC87676%27 HTTP/1.1" 200 None
2026-03-28 07:39:57 [auto1.de] INFO: Scrape type for SC87676: 0
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: RY42515
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY42515%27 HTTP/1.1" 200 None
2026-03-28 07:39:57 [auto1.de] INFO: Scrape type for RY42515: 0
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: VE74198
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE74198%27 HTTP/1.1" 200 None
2026-03-28 07:39:57 [auto1.de] INFO: Scrape type for VE74198: 0
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: VD76950
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: PH88741
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: RF82570
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF82570%27 HTTP/1.1" 200 None
2026-03-28 07:39:57 [auto1.de] INFO: Scrape type for RF82570: 0
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: UA95146
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA95146%27 HTTP/1.1" 200 None
2026-03-28 07:39:57 [auto1.de] INFO: Scrape type for UA95146: 0
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: CT48596
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT48596%27 HTTP/1.1" 200 None
2026-03-28 07:39:57 [auto1.de] INFO: Scrape type for CT48596: 0
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: XC02401
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC02401%27 HTTP/1.1" 200 None
2026-03-28 07:39:57 [auto1.de] INFO: Scrape type for XC02401: 0
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: PR60744
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: CT34743
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: RX47602
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: HN83229
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN83229%27 HTTP/1.1" 200 None
2026-03-28 07:39:57 [auto1.de] INFO: Scrape type for HN83229: 0
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: SL35659
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: UC60552
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC60552%27 HTTP/1.1" 200 None
2026-03-28 07:39:57 [auto1.de] INFO: Scrape type for UC60552: 0
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: VV12952
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV12952%27 HTTP/1.1" 200 None
2026-03-28 07:39:57 [auto1.de] INFO: Scrape type for VV12952: 0
2026-03-28 07:39:57 [auto1.de] INFO: Found listing with ID: PU11267
2026-03-28 07:39:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:39:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:39:58 [auto1.de] INFO: Channel: 24h | Page: 132 | totalHits: 9263 | hits on page: 40
2026-03-28 07:39:58 [auto1.de] INFO: Found listing with ID: UA25928
2026-03-28 07:39:58 [auto1.de] INFO: Found listing with ID: GU38218
2026-03-28 07:39:58 [auto1.de] INFO: Found listing with ID: KX72487
2026-03-28 07:39:58 [auto1.de] INFO: Found listing with ID: SX98211
2026-03-28 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX98211%27 HTTP/1.1" 200 None
2026-03-28 07:39:58 [auto1.de] INFO: Scrape type for SX98211: 0
2026-03-28 07:39:58 [auto1.de] INFO: Found listing with ID: LS15583
2026-03-28 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS15583%27 HTTP/1.1" 200 None
2026-03-28 07:39:58 [auto1.de] INFO: Scrape type for LS15583: 2
2026-03-28 07:39:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03182178-267c-5b1d-bdf9-780cf51a11ee with identifier: LS15583
2026-03-28 07:39:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03182178-267c-5b1d-bdf9-780cf51a11ee with scrape type 2
2026-03-28 07:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03182178-267c-5b1d-bdf9-780cf51a11ee with scrape type 2
2026-03-28 07:39:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03182178-267c-5b1d-bdf9-780cf51a11ee, identifier: LS15583
2026-03-28 07:39:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03182178-267c-5b1d-bdf9-780cf51a11ee with identifier: LS15583
2026-03-28 07:39:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03182178-267c-5b1d-bdf9-780cf51a11ee with identifier: LS15583
2026-03-28 07:39:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03182178-267c-5b1d-bdf9-780cf51a11ee with identifier: LS15583 to the API
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-28T16:04:15Z',
'fuel_type': 'petrol',
'id': '03182178-267c-5b1d-bdf9-780cf51a11ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS15583',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 154334,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-08-31',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 CGI T BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'T BlueEfficiency Avantgarde',
'year': 2010}
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS15583%27 HTTP/1.1" 200 None
2026-03-28 07:39:59 [auto1.de] INFO: Saving data for LS15583: {'auction_closing_time': 1774713855.0, 'created_time': 1774032582.380955, 'last_price_update_time': 1774683599.342645}
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS15583') HTTP/1.1" 204 0
2026-03-28 07:39:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: KK19800
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK19800%27 HTTP/1.1" 200 None
2026-03-28 07:39:59 [auto1.de] INFO: Scrape type for KK19800: 0
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: XV84732
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: UH43382
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH43382%27 HTTP/1.1" 200 None
2026-03-28 07:39:59 [auto1.de] INFO: Scrape type for UH43382: 0
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: EP31898
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: VR43125
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR43125%27 HTTP/1.1" 200 None
2026-03-28 07:39:59 [auto1.de] INFO: Scrape type for VR43125: 0
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: BK73701
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: DG24182
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG24182%27 HTTP/1.1" 200 None
2026-03-28 07:39:59 [auto1.de] INFO: Scrape type for DG24182: 0
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: CF53394
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: JA20872
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA20872%27 HTTP/1.1" 200 None
2026-03-28 07:39:59 [auto1.de] INFO: Scrape type for JA20872: 0
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: SC92395
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC92395%27 HTTP/1.1" 200 None
2026-03-28 07:39:59 [auto1.de] INFO: Scrape type for SC92395: 0
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: HE94758
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: HD83782
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: MS15340
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: DL54594
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: SJ07380
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: FZ02715
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ02715%27 HTTP/1.1" 200 None
2026-03-28 07:39:59 [auto1.de] INFO: Scrape type for FZ02715: 0
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: YL47006
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL47006%27 HTTP/1.1" 200 None
2026-03-28 07:39:59 [auto1.de] INFO: Scrape type for YL47006: 0
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: NH90612
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: LZ63004
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: VN15291
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: TA95211
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: JH32543
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH32543%27 HTTP/1.1" 200 None
2026-03-28 07:39:59 [auto1.de] INFO: Scrape type for JH32543: 0
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: FX11245
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: EK20296
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: TN24608
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: NA05551
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA05551%27 HTTP/1.1" 200 None
2026-03-28 07:39:59 [auto1.de] INFO: Scrape type for NA05551: 0
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: VJ91223
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: NP76557
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: KM31933
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM31933%27 HTTP/1.1" 200 None
2026-03-28 07:39:59 [auto1.de] INFO: Scrape type for KM31933: 0
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: BU33854
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: MG02873
2026-03-28 07:39:59 [auto1.de] INFO: Found listing with ID: XA58573
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA58573%27 HTTP/1.1" 200 None
2026-03-28 07:39:59 [auto1.de] INFO: Scrape type for XA58573: 2
2026-03-28 07:39:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc828d95-62c4-5c10-8a05-351df2e39691 with identifier: XA58573
2026-03-28 07:39:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc828d95-62c4-5c10-8a05-351df2e39691 with scrape type 2
2026-03-28 07:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc828d95-62c4-5c10-8a05-351df2e39691 with scrape type 2
2026-03-28 07:39:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc828d95-62c4-5c10-8a05-351df2e39691, identifier: XA58573
2026-03-28 07:39:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc828d95-62c4-5c10-8a05-351df2e39691 with identifier: XA58573
2026-03-28 07:39:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc828d95-62c4-5c10-8a05-351df2e39691 with identifier: XA58573
2026-03-28 07:39:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc828d95-62c4-5c10-8a05-351df2e39691 with identifier: XA58573 to the API
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:39:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:40:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:27:27Z',
'fuel_type': 'diesel',
'id': 'cc828d95-62c4-5c10-8a05-351df2e39691',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA58573',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 166439,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-02',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2017}
2026-03-28 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA58573%27 HTTP/1.1" 200 None
2026-03-28 07:40:00 [auto1.de] INFO: Saving data for XA58573: {'auction_closing_time': 1774715247.0, 'created_time': 1774464807.687127, 'last_price_update_time': 1774683600.092695}
2026-03-28 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA58573') HTTP/1.1" 204 0
2026-03-28 07:40:00 [auto1.de] INFO: Found listing with ID: JR91951
2026-03-28 07:40:00 [auto1.de] INFO: Found listing with ID: DM83543
2026-03-28 07:40:00 [auto1.de] INFO: Found listing with ID: AL68838
2026-03-28 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL68838%27 HTTP/1.1" 200 None
2026-03-28 07:40:00 [auto1.de] INFO: Scrape type for AL68838: 0
2026-03-28 07:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:01 [auto1.de] INFO: Channel: 24h | Page: 133 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: BB70854
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB70854%27 HTTP/1.1" 200 None
2026-03-28 07:40:01 [auto1.de] INFO: Scrape type for BB70854: 0
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: AF55213
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF55213%27 HTTP/1.1" 200 None
2026-03-28 07:40:01 [auto1.de] INFO: Scrape type for AF55213: 0
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: SL88176
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: NR99017
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR99017%27 HTTP/1.1" 200 None
2026-03-28 07:40:01 [auto1.de] INFO: Scrape type for NR99017: 0
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: NX47984
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: XK43796
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK43796%27 HTTP/1.1" 200 None
2026-03-28 07:40:01 [auto1.de] INFO: Scrape type for XK43796: 0
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: AM90654
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: AE81199
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: XA78750
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA78750%27 HTTP/1.1" 200 None
2026-03-28 07:40:01 [auto1.de] INFO: Scrape type for XA78750: 2
2026-03-28 07:40:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f614dd7-406d-51f8-bca4-e9c55991c13b with identifier: XA78750
2026-03-28 07:40:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f614dd7-406d-51f8-bca4-e9c55991c13b with scrape type 2
2026-03-28 07:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f614dd7-406d-51f8-bca4-e9c55991c13b with scrape type 2
2026-03-28 07:40:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f614dd7-406d-51f8-bca4-e9c55991c13b, identifier: XA78750
2026-03-28 07:40:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f614dd7-406d-51f8-bca4-e9c55991c13b with identifier: XA78750
2026-03-28 07:40:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f614dd7-406d-51f8-bca4-e9c55991c13b with identifier: XA78750
2026-03-28 07:40:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f614dd7-406d-51f8-bca4-e9c55991c13b with identifier: XA78750 to the API
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:40:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:18:09Z',
'fuel_type': 'diesel',
'id': '8f614dd7-406d-51f8-bca4-e9c55991c13b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA78750',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 161659,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-29',
'seller_name': None,
'title': 'Audi A4 2.0 TDI clean diesel Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2015}
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA78750%27 HTTP/1.1" 200 None
2026-03-28 07:40:01 [auto1.de] INFO: Saving data for XA78750: {'auction_closing_time': 1774714689.0, 'created_time': 1774467760.707429, 'last_price_update_time': 1774683601.699812}
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA78750') HTTP/1.1" 204 0
2026-03-28 07:40:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: DC32066
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC32066%27 HTTP/1.1" 200 None
2026-03-28 07:40:01 [auto1.de] INFO: Scrape type for DC32066: 0
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: NS17757
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: RU51432
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: FJ71547
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71547%27 HTTP/1.1" 200 None
2026-03-28 07:40:01 [auto1.de] INFO: Scrape type for FJ71547: 0
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: NX61710
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: LL60236
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL60236%27 HTTP/1.1" 200 None
2026-03-28 07:40:01 [auto1.de] INFO: Scrape type for LL60236: 0
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: CW00084
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: JC86986
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC86986%27 HTTP/1.1" 200 None
2026-03-28 07:40:01 [auto1.de] INFO: Scrape type for JC86986: 0
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: DW76497
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: BB99757
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB99757%27 HTTP/1.1" 200 None
2026-03-28 07:40:01 [auto1.de] INFO: Scrape type for BB99757: 0
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: NW88180
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: TD86732
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: CY30248
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: JY40414
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: BW18198
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: FC58368
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC58368%27 HTTP/1.1" 200 None
2026-03-28 07:40:01 [auto1.de] INFO: Scrape type for FC58368: 0
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: TZ47982
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ47982%27 HTTP/1.1" 200 None
2026-03-28 07:40:01 [auto1.de] INFO: Scrape type for TZ47982: 0
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: RZ82466
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: SJ24740
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: UZ74355
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ74355%27 HTTP/1.1" 200 None
2026-03-28 07:40:01 [auto1.de] INFO: Scrape type for UZ74355: 0
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: NS26780
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: PS90319
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: KE01132
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE01132%27 HTTP/1.1" 200 None
2026-03-28 07:40:01 [auto1.de] INFO: Scrape type for KE01132: 0
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: LT29180
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT29180%27 HTTP/1.1" 200 None
2026-03-28 07:40:01 [auto1.de] INFO: Scrape type for LT29180: 0
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: LB67403
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: JF05808
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: TK16226
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK16226%27 HTTP/1.1" 200 None
2026-03-28 07:40:01 [auto1.de] INFO: Scrape type for TK16226: 0
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: TT57890
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT57890%27 HTTP/1.1" 200 None
2026-03-28 07:40:01 [auto1.de] INFO: Scrape type for TT57890: 0
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: DJ51254
2026-03-28 07:40:01 [auto1.de] INFO: Found listing with ID: YU83796
2026-03-28 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU83796%27 HTTP/1.1" 200 None
2026-03-28 07:40:02 [auto1.de] INFO: Scrape type for YU83796: 0
2026-03-28 07:40:02 [auto1.de] INFO: Found listing with ID: MC69974
2026-03-28 07:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:03 [auto1.de] INFO: Channel: 24h | Page: 134 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: SW40365
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: AH38821
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: TP89237
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP89237%27 HTTP/1.1" 200 None
2026-03-28 07:40:03 [auto1.de] INFO: Scrape type for TP89237: 2
2026-03-28 07:40:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21222d35-0ea2-5097-8676-15a9bfdbf39a with identifier: TP89237
2026-03-28 07:40:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21222d35-0ea2-5097-8676-15a9bfdbf39a with scrape type 2
2026-03-28 07:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21222d35-0ea2-5097-8676-15a9bfdbf39a with scrape type 2
2026-03-28 07:40:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21222d35-0ea2-5097-8676-15a9bfdbf39a, identifier: TP89237
2026-03-28 07:40:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21222d35-0ea2-5097-8676-15a9bfdbf39a with identifier: TP89237
2026-03-28 07:40:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21222d35-0ea2-5097-8676-15a9bfdbf39a with identifier: TP89237
2026-03-28 07:40:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21222d35-0ea2-5097-8676-15a9bfdbf39a with identifier: TP89237 to the API
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:40:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:15:35Z',
'fuel_type': 'diesel',
'id': '21222d35-0ea2-5097-8676-15a9bfdbf39a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP89237',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 108752,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-07',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Exclusive-Line AWD',
'transmission': 'automatic',
'trim': 'Exclusive-Line AWD',
'year': 2016}
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP89237%27 HTTP/1.1" 200 None
2026-03-28 07:40:03 [auto1.de] INFO: Saving data for TP89237: {'auction_closing_time': 1774714535.0, 'created_time': 1774466430.81623, 'last_price_update_time': 1774683603.630291}
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP89237') HTTP/1.1" 204 0
2026-03-28 07:40:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: MN03229
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN03229%27 HTTP/1.1" 200 None
2026-03-28 07:40:03 [auto1.de] INFO: Scrape type for MN03229: 0
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: LX44936
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX44936%27 HTTP/1.1" 200 None
2026-03-28 07:40:03 [auto1.de] INFO: Scrape type for LX44936: 0
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: GG65874
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: JS58048
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: AW26108
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW26108%27 HTTP/1.1" 200 None
2026-03-28 07:40:03 [auto1.de] INFO: Scrape type for AW26108: 0
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: TY75534
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY75534%27 HTTP/1.1" 200 None
2026-03-28 07:40:03 [auto1.de] INFO: Scrape type for TY75534: 0
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: TH98147
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: GB84856
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB84856%27 HTTP/1.1" 200 None
2026-03-28 07:40:03 [auto1.de] INFO: Scrape type for GB84856: 0
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: SN71189
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: SG03941
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG03941%27 HTTP/1.1" 200 None
2026-03-28 07:40:03 [auto1.de] INFO: Scrape type for SG03941: 0
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: HB57575
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: UC97220
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: RG09784
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: HR87119
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: XH73530
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: VC28435
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC28435%27 HTTP/1.1" 200 None
2026-03-28 07:40:03 [auto1.de] INFO: Scrape type for VC28435: 0
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: AD00479
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD00479%27 HTTP/1.1" 200 None
2026-03-28 07:40:03 [auto1.de] INFO: Scrape type for AD00479: 0
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: SS53525
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: CA90460
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA90460%27 HTTP/1.1" 200 None
2026-03-28 07:40:03 [auto1.de] INFO: Scrape type for CA90460: 0
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: SM57605
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: HV61627
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV61627%27 HTTP/1.1" 200 None
2026-03-28 07:40:03 [auto1.de] INFO: Scrape type for HV61627: 0
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: TD37503
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: HG98995
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG98995%27 HTTP/1.1" 200 None
2026-03-28 07:40:03 [auto1.de] INFO: Scrape type for HG98995: 0
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: WJ79239
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: WF02803
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF02803%27 HTTP/1.1" 200 None
2026-03-28 07:40:03 [auto1.de] INFO: Scrape type for WF02803: 0
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: KJ03468
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ03468%27 HTTP/1.1" 200 None
2026-03-28 07:40:03 [auto1.de] INFO: Scrape type for KJ03468: 0
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: MU84465
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU84465%27 HTTP/1.1" 200 None
2026-03-28 07:40:03 [auto1.de] INFO: Scrape type for MU84465: 0
2026-03-28 07:40:03 [auto1.de] INFO: Found listing with ID: KE21243
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE21243%27 HTTP/1.1" 200 None
2026-03-28 07:40:03 [auto1.de] INFO: Scrape type for KE21243: 2
2026-03-28 07:40:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19af9278-de13-5a70-b267-634f4d6eada2 with identifier: KE21243
2026-03-28 07:40:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19af9278-de13-5a70-b267-634f4d6eada2 with scrape type 2
2026-03-28 07:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19af9278-de13-5a70-b267-634f4d6eada2 with scrape type 2
2026-03-28 07:40:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19af9278-de13-5a70-b267-634f4d6eada2, identifier: KE21243
2026-03-28 07:40:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19af9278-de13-5a70-b267-634f4d6eada2 with identifier: KE21243
2026-03-28 07:40:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19af9278-de13-5a70-b267-634f4d6eada2 with identifier: KE21243
2026-03-28 07:40:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19af9278-de13-5a70-b267-634f4d6eada2 with identifier: KE21243 to the API
2026-03-28 07:40:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:40:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:40:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:26:57Z',
'fuel_type': 'diesel',
'id': '19af9278-de13-5a70-b267-634f4d6eada2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE21243',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-3',
'odometer': 185928,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-27',
'seller_name': None,
'title': 'Mazda CX-3 1.5 Diesel Center-Line',
'transmission': 'manual',
'trim': 'Center-Line',
'year': 2016}
2026-03-28 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE21243%27 HTTP/1.1" 200 None
2026-03-28 07:40:04 [auto1.de] INFO: Saving data for KE21243: {'auction_closing_time': 1774715217.0, 'created_time': 1773428978.304008, 'last_price_update_time': 1774683604.437577}
2026-03-28 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE21243') HTTP/1.1" 204 0
2026-03-28 07:40:04 [auto1.de] INFO: Found listing with ID: XE92284
2026-03-28 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE92284%27 HTTP/1.1" 200 None
2026-03-28 07:40:04 [auto1.de] INFO: Scrape type for XE92284: 0
2026-03-28 07:40:04 [auto1.de] INFO: Found listing with ID: PF58362
2026-03-28 07:40:04 [auto1.de] INFO: Found listing with ID: RB75427
2026-03-28 07:40:04 [auto1.de] INFO: Found listing with ID: FP76124
2026-03-28 07:40:04 [auto1.de] INFO: Found listing with ID: NX86319
2026-03-28 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX86319%27 HTTP/1.1" 200 None
2026-03-28 07:40:04 [auto1.de] INFO: Scrape type for NX86319: 0
2026-03-28 07:40:04 [auto1.de] INFO: Found listing with ID: RA95780
2026-03-28 07:40:04 [auto1.de] INFO: Found listing with ID: EN92666
2026-03-28 07:40:04 [auto1.de] INFO: Found listing with ID: MD04990
2026-03-28 07:40:04 [auto1.de] INFO: Found listing with ID: NL19475
2026-03-28 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL19475%27 HTTP/1.1" 200 None
2026-03-28 07:40:04 [auto1.de] INFO: Scrape type for NL19475: 0
2026-03-28 07:40:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:05 [auto1.de] INFO: Channel: 24h | Page: 135 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:05 [auto1.de] INFO: Found listing with ID: NH29659
2026-03-28 07:40:05 [auto1.de] INFO: Found listing with ID: FW12178
2026-03-28 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW12178%27 HTTP/1.1" 200 None
2026-03-28 07:40:05 [auto1.de] INFO: Scrape type for FW12178: 0
2026-03-28 07:40:05 [auto1.de] INFO: Found listing with ID: XY98739
2026-03-28 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY98739%27 HTTP/1.1" 200 None
2026-03-28 07:40:05 [auto1.de] INFO: Scrape type for XY98739: 0
2026-03-28 07:40:05 [auto1.de] INFO: Found listing with ID: YF03838
2026-03-28 07:40:05 [auto1.de] INFO: Found listing with ID: CK05183
2026-03-28 07:40:05 [auto1.de] INFO: Found listing with ID: VY08054
2026-03-28 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY08054%27 HTTP/1.1" 200 None
2026-03-28 07:40:05 [auto1.de] INFO: Scrape type for VY08054: 2
2026-03-28 07:40:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3b3e7d5-3abe-5d35-b76e-575ad020762d with identifier: VY08054
2026-03-28 07:40:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3b3e7d5-3abe-5d35-b76e-575ad020762d with scrape type 2
2026-03-28 07:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3b3e7d5-3abe-5d35-b76e-575ad020762d with scrape type 2
2026-03-28 07:40:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3b3e7d5-3abe-5d35-b76e-575ad020762d, identifier: VY08054
2026-03-28 07:40:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3b3e7d5-3abe-5d35-b76e-575ad020762d with identifier: VY08054
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-28 07:40:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 07:40:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3b3e7d5-3abe-5d35-b76e-575ad020762d with identifier: VY08054
2026-03-28 07:40:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3b3e7d5-3abe-5d35-b76e-575ad020762d with identifier: VY08054 to the API
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:40:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:08:08Z',
'fuel_type': 'petrol',
'id': 'b3b3e7d5-3abe-5d35-b76e-575ad020762d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY08054',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 83718,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-16',
'seller_name': None,
'title': 'Opel Corsa 1.4 Innovation',
'transmission': 'automatic',
'trim': 'Innovation',
'year': 2010}
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY08054%27 HTTP/1.1" 200 None
2026-03-28 07:40:06 [auto1.de] INFO: Saving data for VY08054: {'auction_closing_time': 1774714088.0, 'created_time': 1774466191.77949, 'last_price_update_time': 1774683606.458111}
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY08054') HTTP/1.1" 204 0
2026-03-28 07:40:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: HN30434
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: ZJ77076
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ77076%27 HTTP/1.1" 200 None
2026-03-28 07:40:06 [auto1.de] INFO: Scrape type for ZJ77076: 0
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: CL67465
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: SL22871
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: BC91318
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC91318%27 HTTP/1.1" 200 None
2026-03-28 07:40:06 [auto1.de] INFO: Scrape type for BC91318: 0
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: NR35132
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: LE21028
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: VX05177
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX05177%27 HTTP/1.1" 200 None
2026-03-28 07:40:06 [auto1.de] INFO: Scrape type for VX05177: 0
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: VA96509
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA96509%27 HTTP/1.1" 200 None
2026-03-28 07:40:06 [auto1.de] INFO: Scrape type for VA96509: 0
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: EN28184
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: VV83737
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV83737%27 HTTP/1.1" 200 None
2026-03-28 07:40:06 [auto1.de] INFO: Scrape type for VV83737: 0
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: LN54864
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN54864%27 HTTP/1.1" 200 None
2026-03-28 07:40:06 [auto1.de] INFO: Scrape type for LN54864: 0
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: MN16875
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: FJ59551
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: AV05824
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV05824%27 HTTP/1.1" 200 None
2026-03-28 07:40:06 [auto1.de] INFO: Scrape type for AV05824: 0
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: JS88024
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: WM05984
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: WB93098
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: EM02762
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: DW83875
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: NK75444
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: AW09082
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW09082%27 HTTP/1.1" 200 None
2026-03-28 07:40:06 [auto1.de] INFO: Scrape type for AW09082: 0
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: AS89586
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: DR39868
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: XE25364
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: FW17566
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: ZY88037
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY88037%27 HTTP/1.1" 200 None
2026-03-28 07:40:06 [auto1.de] INFO: Scrape type for ZY88037: 0
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: BV75755
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: VS99519
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS99519%27 HTTP/1.1" 200 None
2026-03-28 07:40:06 [auto1.de] INFO: Scrape type for VS99519: 0
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: BZ38132
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ38132%27 HTTP/1.1" 200 None
2026-03-28 07:40:06 [auto1.de] INFO: Scrape type for BZ38132: 0
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: MS67851
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS67851%27 HTTP/1.1" 200 None
2026-03-28 07:40:06 [auto1.de] INFO: Scrape type for MS67851: 0
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: MN63665
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: BJ40023
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ40023%27 HTTP/1.1" 200 None
2026-03-28 07:40:06 [auto1.de] INFO: Scrape type for BJ40023: 0
2026-03-28 07:40:06 [auto1.de] INFO: Found listing with ID: JY42391
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY42391%27 HTTP/1.1" 200 None
2026-03-28 07:40:06 [auto1.de] INFO: Scrape type for JY42391: 0
2026-03-28 07:40:06 [scrapy.extensions.logstats] INFO: Crawled 141 pages (at 23 pages/min), scraped 475 items (at 45 items/min)
2026-03-28 07:40:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 165MiB
2026-03-28 07:40:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:07 [auto1.de] INFO: Channel: 24h | Page: 136 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: RB92475
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: FZ45085
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ45085%27 HTTP/1.1" 200 None
2026-03-28 07:40:07 [auto1.de] INFO: Scrape type for FZ45085: 0
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: EJ57142
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ57142%27 HTTP/1.1" 200 None
2026-03-28 07:40:07 [auto1.de] INFO: Scrape type for EJ57142: 0
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: YE52514
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE52514%27 HTTP/1.1" 200 None
2026-03-28 07:40:07 [auto1.de] INFO: Scrape type for YE52514: 0
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: AK40510
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK40510%27 HTTP/1.1" 200 None
2026-03-28 07:40:07 [auto1.de] INFO: Scrape type for AK40510: 0
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: SG28932
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28932%27 HTTP/1.1" 200 None
2026-03-28 07:40:07 [auto1.de] INFO: Scrape type for SG28932: 0
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: CJ04557
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: PF70516
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF70516%27 HTTP/1.1" 200 None
2026-03-28 07:40:07 [auto1.de] INFO: Scrape type for PF70516: 0
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: KM46516
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM46516%27 HTTP/1.1" 200 None
2026-03-28 07:40:07 [auto1.de] INFO: Scrape type for KM46516: 0
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: NL19683
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: RE98096
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: WC37981
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: PM59484
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: YA43957
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA43957%27 HTTP/1.1" 200 None
2026-03-28 07:40:07 [auto1.de] INFO: Scrape type for YA43957: 0
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: RK76188
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: VN12200
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: AC23396
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: UD27058
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: UY36184
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY36184%27 HTTP/1.1" 200 None
2026-03-28 07:40:07 [auto1.de] INFO: Scrape type for UY36184: 0
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: BV95074
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: JY67859
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY67859%27 HTTP/1.1" 200 None
2026-03-28 07:40:07 [auto1.de] INFO: Scrape type for JY67859: 0
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: DY63135
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY63135%27 HTTP/1.1" 200 None
2026-03-28 07:40:07 [auto1.de] INFO: Scrape type for DY63135: 0
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: TH48846
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH48846%27 HTTP/1.1" 200 None
2026-03-28 07:40:07 [auto1.de] INFO: Scrape type for TH48846: 0
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: RC32924
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC32924%27 HTTP/1.1" 200 None
2026-03-28 07:40:07 [auto1.de] INFO: Scrape type for RC32924: 0
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: NE41084
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: RZ91984
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ91984%27 HTTP/1.1" 200 None
2026-03-28 07:40:07 [auto1.de] INFO: Scrape type for RZ91984: 0
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: GZ84157
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ84157%27 HTTP/1.1" 200 None
2026-03-28 07:40:07 [auto1.de] INFO: Scrape type for GZ84157: 0
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: ES51146
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES51146%27 HTTP/1.1" 200 None
2026-03-28 07:40:07 [auto1.de] INFO: Scrape type for ES51146: 0
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: MR97164
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: LF08399
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: PM35820
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: RU55030
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: WW62013
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: WR30100
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: XV83680
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV83680%27 HTTP/1.1" 200 None
2026-03-28 07:40:07 [auto1.de] INFO: Scrape type for XV83680: 0
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: TX49680
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX49680%27 HTTP/1.1" 200 None
2026-03-28 07:40:07 [auto1.de] INFO: Scrape type for TX49680: 0
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: YH32821
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: EE66446
2026-03-28 07:40:07 [auto1.de] INFO: Found listing with ID: AG95763
2026-03-28 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG95763%27 HTTP/1.1" 200 None
2026-03-28 07:40:08 [auto1.de] INFO: Scrape type for AG95763: 0
2026-03-28 07:40:08 [auto1.de] INFO: Found listing with ID: HB95845
2026-03-28 07:40:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:08 [auto1.de] INFO: Channel: 24h | Page: 137 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:08 [auto1.de] INFO: Found listing with ID: SA20211
2026-03-28 07:40:08 [auto1.de] INFO: Found listing with ID: BS47149
2026-03-28 07:40:08 [auto1.de] INFO: Found listing with ID: UV43425
2026-03-28 07:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV43425%27 HTTP/1.1" 200 None
2026-03-28 07:40:09 [auto1.de] INFO: Scrape type for UV43425: 0
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: UE48673
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: DC02620
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: XU38066
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: WT35488
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT35488%27 HTTP/1.1" 200 None
2026-03-28 07:40:09 [auto1.de] INFO: Scrape type for WT35488: 0
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: DV40651
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: RT81872
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT81872%27 HTTP/1.1" 200 None
2026-03-28 07:40:09 [auto1.de] INFO: Scrape type for RT81872: 0
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: VF65957
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: EU14663
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU14663%27 HTTP/1.1" 200 None
2026-03-28 07:40:09 [auto1.de] INFO: Scrape type for EU14663: 0
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: NH24337
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: AP35212
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: UJ19896
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ19896%27 HTTP/1.1" 200 None
2026-03-28 07:40:09 [auto1.de] INFO: Scrape type for UJ19896: 0
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: FS21817
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: NV29548
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: YC36661
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC36661%27 HTTP/1.1" 200 None
2026-03-28 07:40:09 [auto1.de] INFO: Scrape type for YC36661: 0
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: FB28212
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB28212%27 HTTP/1.1" 200 None
2026-03-28 07:40:09 [auto1.de] INFO: Scrape type for FB28212: 0
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: XV50730
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: AB51918
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB51918%27 HTTP/1.1" 200 None
2026-03-28 07:40:09 [auto1.de] INFO: Scrape type for AB51918: 0
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: WB14215
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: WX47681
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: FN84254
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN84254%27 HTTP/1.1" 200 None
2026-03-28 07:40:09 [auto1.de] INFO: Scrape type for FN84254: 0
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: VL22817
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: WM17924
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM17924%27 HTTP/1.1" 200 None
2026-03-28 07:40:09 [auto1.de] INFO: Scrape type for WM17924: 0
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: VV56581
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV56581%27 HTTP/1.1" 200 None
2026-03-28 07:40:09 [auto1.de] INFO: Scrape type for VV56581: 0
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: PH05678
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: ZR87762
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR87762%27 HTTP/1.1" 200 None
2026-03-28 07:40:09 [auto1.de] INFO: Scrape type for ZR87762: 0
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: WZ46352
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ46352%27 HTTP/1.1" 200 None
2026-03-28 07:40:09 [auto1.de] INFO: Scrape type for WZ46352: 0
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: CG13021
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: SW73326
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW73326%27 HTTP/1.1" 200 None
2026-03-28 07:40:09 [auto1.de] INFO: Scrape type for SW73326: 0
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: FH57861
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: NR21385
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: MB34428
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: UE28545
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: DP38441
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP38441%27 HTTP/1.1" 200 None
2026-03-28 07:40:09 [auto1.de] INFO: Scrape type for DP38441: 0
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: TE81781
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE81781%27 HTTP/1.1" 200 None
2026-03-28 07:40:09 [auto1.de] INFO: Scrape type for TE81781: 0
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: EZ75910
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: MW86631
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW86631%27 HTTP/1.1" 200 None
2026-03-28 07:40:09 [auto1.de] INFO: Scrape type for MW86631: 0
2026-03-28 07:40:09 [auto1.de] INFO: Found listing with ID: CT92868
2026-03-28 07:40:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:10 [auto1.de] INFO: Channel: 24h | Page: 138 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: AT97457
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT97457%27 HTTP/1.1" 200 None
2026-03-28 07:40:10 [auto1.de] INFO: Scrape type for AT97457: 0
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: WF64949
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF64949%27 HTTP/1.1" 200 None
2026-03-28 07:40:10 [auto1.de] INFO: Scrape type for WF64949: 0
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: LX19893
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: ED90776
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED90776%27 HTTP/1.1" 200 None
2026-03-28 07:40:10 [auto1.de] INFO: Scrape type for ED90776: 0
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: RC44114
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: XB12574
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: GS10742
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS10742%27 HTTP/1.1" 200 None
2026-03-28 07:40:10 [auto1.de] INFO: Scrape type for GS10742: 0
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: ZF51547
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: FY44506
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: NV36056
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: FA69463
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA69463%27 HTTP/1.1" 200 None
2026-03-28 07:40:10 [auto1.de] INFO: Scrape type for FA69463: 0
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: SB19152
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB19152%27 HTTP/1.1" 200 None
2026-03-28 07:40:10 [auto1.de] INFO: Scrape type for SB19152: 0
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: CV58900
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV58900%27 HTTP/1.1" 200 None
2026-03-28 07:40:10 [auto1.de] INFO: Scrape type for CV58900: 0
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: VU26933
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: PV39631
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: BE79693
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: EL88156
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL88156%27 HTTP/1.1" 200 None
2026-03-28 07:40:10 [auto1.de] INFO: Scrape type for EL88156: 0
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: UV51707
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV51707%27 HTTP/1.1" 200 None
2026-03-28 07:40:10 [auto1.de] INFO: Scrape type for UV51707: 0
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: NR97756
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: WJ30276
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ30276%27 HTTP/1.1" 200 None
2026-03-28 07:40:10 [auto1.de] INFO: Scrape type for WJ30276: 0
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: ZR75909
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR75909%27 HTTP/1.1" 200 None
2026-03-28 07:40:10 [auto1.de] INFO: Scrape type for ZR75909: 0
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: TN86054
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: TL60563
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL60563%27 HTTP/1.1" 200 None
2026-03-28 07:40:10 [auto1.de] INFO: Scrape type for TL60563: 0
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: HS07572
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS07572%27 HTTP/1.1" 200 None
2026-03-28 07:40:10 [auto1.de] INFO: Scrape type for HS07572: 0
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: XS14457
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: FG49990
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: EW66655
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW66655%27 HTTP/1.1" 200 None
2026-03-28 07:40:10 [auto1.de] INFO: Scrape type for EW66655: 0
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: PG72252
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG72252%27 HTTP/1.1" 200 None
2026-03-28 07:40:10 [auto1.de] INFO: Scrape type for PG72252: 0
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: EB23649
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: MA26612
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: ST40572
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST40572%27 HTTP/1.1" 200 None
2026-03-28 07:40:10 [auto1.de] INFO: Scrape type for ST40572: 0
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: WY12370
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY12370%27 HTTP/1.1" 200 None
2026-03-28 07:40:10 [auto1.de] INFO: Scrape type for WY12370: 0
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: WJ46196
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ46196%27 HTTP/1.1" 200 None
2026-03-28 07:40:10 [auto1.de] INFO: Scrape type for WJ46196: 0
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: LL82276
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: BB55573
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: JU35192
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: BB56040
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: PW70056
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW70056%27 HTTP/1.1" 200 None
2026-03-28 07:40:10 [auto1.de] INFO: Scrape type for PW70056: 0
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: SY50059
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY50059%27 HTTP/1.1" 200 None
2026-03-28 07:40:10 [auto1.de] INFO: Scrape type for SY50059: 0
2026-03-28 07:40:10 [auto1.de] INFO: Found listing with ID: HG82543
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG82543%27 HTTP/1.1" 200 None
2026-03-28 07:40:10 [auto1.de] INFO: Scrape type for HG82543: 0
2026-03-28 07:40:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:11 [auto1.de] INFO: Channel: 24h | Page: 139 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: FZ03157
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: NX23620
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: YR50974
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: VW78119
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: BX36135
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: EL52738
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: NW97614
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: JH89792
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: KZ71563
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: GP99988
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: JN58244
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: GH08686
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: SW09087
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: ZZ75608
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: JH65606
2026-03-28 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH65606%27 HTTP/1.1" 200 None
2026-03-28 07:40:11 [auto1.de] INFO: Scrape type for JH65606: 0
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: TR29242
2026-03-28 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR29242%27 HTTP/1.1" 200 None
2026-03-28 07:40:11 [auto1.de] INFO: Scrape type for TR29242: 0
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: UC42485
2026-03-28 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC42485%27 HTTP/1.1" 200 None
2026-03-28 07:40:11 [auto1.de] INFO: Scrape type for UC42485: 0
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: ZH33487
2026-03-28 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH33487%27 HTTP/1.1" 200 None
2026-03-28 07:40:11 [auto1.de] INFO: Scrape type for ZH33487: 0
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: PR32906
2026-03-28 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR32906%27 HTTP/1.1" 200 None
2026-03-28 07:40:11 [auto1.de] INFO: Scrape type for PR32906: 0
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: CR33136
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: YA52648
2026-03-28 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA52648%27 HTTP/1.1" 200 None
2026-03-28 07:40:11 [auto1.de] INFO: Scrape type for YA52648: 0
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: VN00313
2026-03-28 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN00313%27 HTTP/1.1" 200 None
2026-03-28 07:40:11 [auto1.de] INFO: Scrape type for VN00313: 0
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: LK64393
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: RK60330
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: ET79003
2026-03-28 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET79003%27 HTTP/1.1" 200 None
2026-03-28 07:40:11 [auto1.de] INFO: Scrape type for ET79003: 0
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: NZ73974
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: NV48270
2026-03-28 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV48270%27 HTTP/1.1" 200 None
2026-03-28 07:40:11 [auto1.de] INFO: Scrape type for NV48270: 0
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: GN89832
2026-03-28 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN89832%27 HTTP/1.1" 200 None
2026-03-28 07:40:11 [auto1.de] INFO: Scrape type for GN89832: 0
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: VH78642
2026-03-28 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH78642%27 HTTP/1.1" 200 None
2026-03-28 07:40:11 [auto1.de] INFO: Scrape type for VH78642: 0
2026-03-28 07:40:11 [auto1.de] INFO: Found listing with ID: EY51453
2026-03-28 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY51453%27 HTTP/1.1" 200 None
2026-03-28 07:40:12 [auto1.de] INFO: Scrape type for EY51453: 0
2026-03-28 07:40:12 [auto1.de] INFO: Found listing with ID: MJ41620
2026-03-28 07:40:12 [auto1.de] INFO: Found listing with ID: CG19122
2026-03-28 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG19122%27 HTTP/1.1" 200 None
2026-03-28 07:40:12 [auto1.de] INFO: Scrape type for CG19122: 0
2026-03-28 07:40:12 [auto1.de] INFO: Found listing with ID: RR77511
2026-03-28 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR77511%27 HTTP/1.1" 200 None
2026-03-28 07:40:12 [auto1.de] INFO: Scrape type for RR77511: 0
2026-03-28 07:40:12 [auto1.de] INFO: Found listing with ID: HE33973
2026-03-28 07:40:12 [auto1.de] INFO: Found listing with ID: BC06699
2026-03-28 07:40:12 [auto1.de] INFO: Found listing with ID: PP80168
2026-03-28 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP80168%27 HTTP/1.1" 200 None
2026-03-28 07:40:12 [auto1.de] INFO: Scrape type for PP80168: 0
2026-03-28 07:40:12 [auto1.de] INFO: Found listing with ID: TU49372
2026-03-28 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU49372%27 HTTP/1.1" 200 None
2026-03-28 07:40:12 [auto1.de] INFO: Scrape type for TU49372: 0
2026-03-28 07:40:12 [auto1.de] INFO: Found listing with ID: US66505
2026-03-28 07:40:12 [auto1.de] INFO: Found listing with ID: DA76775
2026-03-28 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA76775%27 HTTP/1.1" 200 None
2026-03-28 07:40:12 [auto1.de] INFO: Scrape type for DA76775: 0
2026-03-28 07:40:12 [auto1.de] INFO: Found listing with ID: GG93130
2026-03-28 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG93130%27 HTTP/1.1" 200 None
2026-03-28 07:40:12 [auto1.de] INFO: Scrape type for GG93130: 0
2026-03-28 07:40:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:13 [auto1.de] INFO: Channel: 24h | Page: 140 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: YT05119
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: TZ79275
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ79275%27 HTTP/1.1" 200 None
2026-03-28 07:40:13 [auto1.de] INFO: Scrape type for TZ79275: 0
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: NC36065
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC36065%27 HTTP/1.1" 200 None
2026-03-28 07:40:13 [auto1.de] INFO: Scrape type for NC36065: 0
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: UR77035
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR77035%27 HTTP/1.1" 200 None
2026-03-28 07:40:13 [auto1.de] INFO: Scrape type for UR77035: 0
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: MB29022
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: KA83154
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83154%27 HTTP/1.1" 200 None
2026-03-28 07:40:13 [auto1.de] INFO: Scrape type for KA83154: 0
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: KD94440
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD94440%27 HTTP/1.1" 200 None
2026-03-28 07:40:13 [auto1.de] INFO: Scrape type for KD94440: 0
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: LW88840
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW88840%27 HTTP/1.1" 200 None
2026-03-28 07:40:13 [auto1.de] INFO: Scrape type for LW88840: 0
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: BG03972
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: CK46360
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: ET31330
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: PN64599
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: YK39735
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: BP32495
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP32495%27 HTTP/1.1" 200 None
2026-03-28 07:40:13 [auto1.de] INFO: Scrape type for BP32495: 0
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: ZG82631
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: TL33635
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: RE30080
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: CL90320
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: UU53643
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU53643%27 HTTP/1.1" 200 None
2026-03-28 07:40:13 [auto1.de] INFO: Scrape type for UU53643: 0
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: FP02134
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: SX18617
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: MH67874
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH67874%27 HTTP/1.1" 200 None
2026-03-28 07:40:13 [auto1.de] INFO: Scrape type for MH67874: 0
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: ZS32516
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS32516%27 HTTP/1.1" 200 None
2026-03-28 07:40:13 [auto1.de] INFO: Scrape type for ZS32516: 0
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: NX28269
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX28269%27 HTTP/1.1" 200 None
2026-03-28 07:40:13 [auto1.de] INFO: Scrape type for NX28269: 0
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: HZ93598
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: FP85945
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: KZ93271
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: EL64593
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: MJ27519
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: FV38538
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: WV15803
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: FJ25741
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: VV47802
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: JP48264
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: DB26331
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB26331%27 HTTP/1.1" 200 None
2026-03-28 07:40:13 [auto1.de] INFO: Scrape type for DB26331: 0
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: ME33936
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: AX65936
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: TN55927
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN55927%27 HTTP/1.1" 200 None
2026-03-28 07:40:13 [auto1.de] INFO: Scrape type for TN55927: 0
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: EP13980
2026-03-28 07:40:13 [auto1.de] INFO: Found listing with ID: LV90463
2026-03-28 07:40:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:14 [auto1.de] INFO: Channel: 24h | Page: 141 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: ZD30774
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: GJ71101
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71101%27 HTTP/1.1" 200 None
2026-03-28 07:40:14 [auto1.de] INFO: Scrape type for GJ71101: 0
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: BR25220
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: US43373
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: GZ32415
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ32415%27 HTTP/1.1" 200 None
2026-03-28 07:40:14 [auto1.de] INFO: Scrape type for GZ32415: 0
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: JW43504
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: KX05072
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX05072%27 HTTP/1.1" 200 None
2026-03-28 07:40:14 [auto1.de] INFO: Scrape type for KX05072: 0
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: XG02124
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG02124%27 HTTP/1.1" 200 None
2026-03-28 07:40:14 [auto1.de] INFO: Scrape type for XG02124: 0
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: ST70161
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: JP14233
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP14233%27 HTTP/1.1" 200 None
2026-03-28 07:40:14 [auto1.de] INFO: Scrape type for JP14233: 0
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: NG47626
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG47626%27 HTTP/1.1" 200 None
2026-03-28 07:40:14 [auto1.de] INFO: Scrape type for NG47626: 0
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: JW84966
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW84966%27 HTTP/1.1" 200 None
2026-03-28 07:40:14 [auto1.de] INFO: Scrape type for JW84966: 0
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: RU88109
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU88109%27 HTTP/1.1" 200 None
2026-03-28 07:40:14 [auto1.de] INFO: Scrape type for RU88109: 0
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: YL44466
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: FM50450
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM50450%27 HTTP/1.1" 200 None
2026-03-28 07:40:14 [auto1.de] INFO: Scrape type for FM50450: 0
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: BC43890
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: CP03676
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP03676%27 HTTP/1.1" 200 None
2026-03-28 07:40:14 [auto1.de] INFO: Scrape type for CP03676: 0
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: VB65040
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: ES58004
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: PB97430
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB97430%27 HTTP/1.1" 200 None
2026-03-28 07:40:14 [auto1.de] INFO: Scrape type for PB97430: 0
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: MW99572
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW99572%27 HTTP/1.1" 200 None
2026-03-28 07:40:14 [auto1.de] INFO: Scrape type for MW99572: 0
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: BZ12111
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: LX11356
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: XD42848
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: JA32150
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: FP11362
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: XF72259
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: BP44038
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP44038%27 HTTP/1.1" 200 None
2026-03-28 07:40:14 [auto1.de] INFO: Scrape type for BP44038: 0
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: HV33102
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: TE65215
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: PL91584
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: EN61962
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: VK62428
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: MX54402
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: GZ01520
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ01520%27 HTTP/1.1" 200 None
2026-03-28 07:40:14 [auto1.de] INFO: Scrape type for GZ01520: 0
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: YB52644
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: FC83292
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC83292%27 HTTP/1.1" 200 None
2026-03-28 07:40:14 [auto1.de] INFO: Scrape type for FC83292: 0
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: XG36075
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG36075%27 HTTP/1.1" 200 None
2026-03-28 07:40:14 [auto1.de] INFO: Scrape type for XG36075: 0
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: TD63054
2026-03-28 07:40:14 [auto1.de] INFO: Found listing with ID: JB48041
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB48041%27 HTTP/1.1" 200 None
2026-03-28 07:40:14 [auto1.de] INFO: Scrape type for JB48041: 0
2026-03-28 07:40:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:16 [auto1.de] INFO: Channel: 24h | Page: 142 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: VK55236
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: MW87907
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: EA74334
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: GD86800
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD86800%27 HTTP/1.1" 200 None
2026-03-28 07:40:16 [auto1.de] INFO: Scrape type for GD86800: 0
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: YP75946
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: BE74196
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE74196%27 HTTP/1.1" 200 None
2026-03-28 07:40:16 [auto1.de] INFO: Scrape type for BE74196: 0
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: DA58180
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: WA63684
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: MA19340
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA19340%27 HTTP/1.1" 200 None
2026-03-28 07:40:16 [auto1.de] INFO: Scrape type for MA19340: 0
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: BK24126
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK24126%27 HTTP/1.1" 200 None
2026-03-28 07:40:16 [auto1.de] INFO: Scrape type for BK24126: 0
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: DN59974
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: KS57096
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: FG79588
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: YM02183
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: LA55679
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: XC89129
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: RZ49473
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: PW59842
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW59842%27 HTTP/1.1" 200 None
2026-03-28 07:40:16 [auto1.de] INFO: Scrape type for PW59842: 0
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: FY91836
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: UT32036
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: JJ41202
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ41202%27 HTTP/1.1" 200 None
2026-03-28 07:40:16 [auto1.de] INFO: Scrape type for JJ41202: 0
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: TA32254
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA32254%27 HTTP/1.1" 200 None
2026-03-28 07:40:16 [auto1.de] INFO: Scrape type for TA32254: 0
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: TE19568
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: KK73289
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK73289%27 HTTP/1.1" 200 None
2026-03-28 07:40:16 [auto1.de] INFO: Scrape type for KK73289: 0
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: WM92203
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: WZ27773
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ27773%27 HTTP/1.1" 200 None
2026-03-28 07:40:16 [auto1.de] INFO: Scrape type for WZ27773: 0
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: DR66726
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR66726%27 HTTP/1.1" 200 None
2026-03-28 07:40:16 [auto1.de] INFO: Scrape type for DR66726: 0
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: CG60505
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG60505%27 HTTP/1.1" 200 None
2026-03-28 07:40:16 [auto1.de] INFO: Scrape type for CG60505: 0
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: AK90767
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK90767%27 HTTP/1.1" 200 None
2026-03-28 07:40:16 [auto1.de] INFO: Scrape type for AK90767: 0
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: MR96643
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: VJ93938
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ93938%27 HTTP/1.1" 200 None
2026-03-28 07:40:16 [auto1.de] INFO: Scrape type for VJ93938: 0
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: UZ05424
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: BJ70582
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: JL01177
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL01177%27 HTTP/1.1" 200 None
2026-03-28 07:40:16 [auto1.de] INFO: Scrape type for JL01177: 0
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: EZ09435
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: JH49592
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: FJ78766
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78766%27 HTTP/1.1" 200 None
2026-03-28 07:40:16 [auto1.de] INFO: Scrape type for FJ78766: 0
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: KP76789
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: GP28928
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP28928%27 HTTP/1.1" 200 None
2026-03-28 07:40:16 [auto1.de] INFO: Scrape type for GP28928: 0
2026-03-28 07:40:16 [auto1.de] INFO: Found listing with ID: KL19595
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL19595%27 HTTP/1.1" 200 None
2026-03-28 07:40:16 [auto1.de] INFO: Scrape type for KL19595: 0
2026-03-28 07:40:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:17 [auto1.de] INFO: Channel: 24h | Page: 143 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: SG53147
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG53147%27 HTTP/1.1" 200 None
2026-03-28 07:40:17 [auto1.de] INFO: Scrape type for SG53147: 0
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: BH54290
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: ME45713
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME45713%27 HTTP/1.1" 200 None
2026-03-28 07:40:17 [auto1.de] INFO: Scrape type for ME45713: 0
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: UC83378
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC83378%27 HTTP/1.1" 200 None
2026-03-28 07:40:17 [auto1.de] INFO: Scrape type for UC83378: 0
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: HJ47898
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ47898%27 HTTP/1.1" 200 None
2026-03-28 07:40:17 [auto1.de] INFO: Scrape type for HJ47898: 0
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: JM37060
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: JZ63393
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: KB63529
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: DF58718
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: KC83208
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: DF80401
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF80401%27 HTTP/1.1" 200 None
2026-03-28 07:40:17 [auto1.de] INFO: Scrape type for DF80401: 0
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: HA43424
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: AK10230
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: XF71877
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF71877%27 HTTP/1.1" 200 None
2026-03-28 07:40:17 [auto1.de] INFO: Scrape type for XF71877: 0
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: RA44966
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: GE38296
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE38296%27 HTTP/1.1" 200 None
2026-03-28 07:40:17 [auto1.de] INFO: Scrape type for GE38296: 0
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: TC10400
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC10400%27 HTTP/1.1" 200 None
2026-03-28 07:40:17 [auto1.de] INFO: Scrape type for TC10400: 0
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: LW37841
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW37841%27 HTTP/1.1" 200 None
2026-03-28 07:40:17 [auto1.de] INFO: Scrape type for LW37841: 0
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: UZ23032
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: MU37788
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU37788%27 HTTP/1.1" 200 None
2026-03-28 07:40:17 [auto1.de] INFO: Scrape type for MU37788: 0
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: ST46361
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST46361%27 HTTP/1.1" 200 None
2026-03-28 07:40:17 [auto1.de] INFO: Scrape type for ST46361: 0
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: CV46070
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV46070%27 HTTP/1.1" 200 None
2026-03-28 07:40:17 [auto1.de] INFO: Scrape type for CV46070: 0
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: CU54451
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: GE13857
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: YE54237
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE54237%27 HTTP/1.1" 200 None
2026-03-28 07:40:17 [auto1.de] INFO: Scrape type for YE54237: 0
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: UC90003
2026-03-28 07:40:17 [auto1.de] INFO: Found listing with ID: PM00839
2026-03-28 07:40:18 [auto1.de] INFO: Found listing with ID: YG24433
2026-03-28 07:40:18 [auto1.de] INFO: Found listing with ID: RA09675
2026-03-28 07:40:18 [auto1.de] INFO: Found listing with ID: YN58840
2026-03-28 07:40:18 [auto1.de] INFO: Found listing with ID: SR24590
2026-03-28 07:40:18 [auto1.de] INFO: Found listing with ID: WP38302
2026-03-28 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP38302%27 HTTP/1.1" 200 None
2026-03-28 07:40:18 [auto1.de] INFO: Scrape type for WP38302: 0
2026-03-28 07:40:18 [auto1.de] INFO: Found listing with ID: LL32931
2026-03-28 07:40:18 [auto1.de] INFO: Found listing with ID: JR72370
2026-03-28 07:40:18 [auto1.de] INFO: Found listing with ID: LH42937
2026-03-28 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH42937%27 HTTP/1.1" 200 None
2026-03-28 07:40:18 [auto1.de] INFO: Scrape type for LH42937: 0
2026-03-28 07:40:18 [auto1.de] INFO: Found listing with ID: RK58200
2026-03-28 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK58200%27 HTTP/1.1" 200 None
2026-03-28 07:40:18 [auto1.de] INFO: Scrape type for RK58200: 0
2026-03-28 07:40:18 [auto1.de] INFO: Found listing with ID: NW48932
2026-03-28 07:40:18 [auto1.de] INFO: Found listing with ID: CU25460
2026-03-28 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU25460%27 HTTP/1.1" 200 None
2026-03-28 07:40:18 [auto1.de] INFO: Scrape type for CU25460: 0
2026-03-28 07:40:18 [auto1.de] INFO: Found listing with ID: LB53588
2026-03-28 07:40:18 [auto1.de] INFO: Found listing with ID: AF22062
2026-03-28 07:40:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:20 [auto1.de] INFO: Channel: 24h | Page: 144 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: VU78681
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: NH66638
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH66638%27 HTTP/1.1" 200 None
2026-03-28 07:40:20 [auto1.de] INFO: Scrape type for NH66638: 0
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: YB76933
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB76933%27 HTTP/1.1" 200 None
2026-03-28 07:40:20 [auto1.de] INFO: Scrape type for YB76933: 0
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: KB30822
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB30822%27 HTTP/1.1" 200 None
2026-03-28 07:40:20 [auto1.de] INFO: Scrape type for KB30822: 0
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: UW51602
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: WB23557
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: YC23372
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC23372%27 HTTP/1.1" 200 None
2026-03-28 07:40:20 [auto1.de] INFO: Scrape type for YC23372: 0
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: PV88036
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV88036%27 HTTP/1.1" 200 None
2026-03-28 07:40:20 [auto1.de] INFO: Scrape type for PV88036: 0
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: PT29728
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: GR22729
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR22729%27 HTTP/1.1" 200 None
2026-03-28 07:40:20 [auto1.de] INFO: Scrape type for GR22729: 0
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: CH93356
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: FV31347
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: RL64280
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: VS97979
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS97979%27 HTTP/1.1" 200 None
2026-03-28 07:40:20 [auto1.de] INFO: Scrape type for VS97979: 0
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: AP67523
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: WJ27645
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ27645%27 HTTP/1.1" 200 None
2026-03-28 07:40:20 [auto1.de] INFO: Scrape type for WJ27645: 0
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: EU36809
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: YR75545
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: YU45811
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: HJ23200
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: NH86896
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: LM35319
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: AA38517
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: ND92917
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: GC41711
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: SS51107
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: BN50743
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN50743%27 HTTP/1.1" 200 None
2026-03-28 07:40:20 [auto1.de] INFO: Scrape type for BN50743: 0
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: RT85975
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: CZ37102
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ37102%27 HTTP/1.1" 200 None
2026-03-28 07:40:20 [auto1.de] INFO: Scrape type for CZ37102: 0
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: UN55665
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: SX94415
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX94415%27 HTTP/1.1" 200 None
2026-03-28 07:40:20 [auto1.de] INFO: Scrape type for SX94415: 0
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: ZH78553
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH78553%27 HTTP/1.1" 200 None
2026-03-28 07:40:20 [auto1.de] INFO: Scrape type for ZH78553: 0
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: GZ12434
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: EF19771
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF19771%27 HTTP/1.1" 200 None
2026-03-28 07:40:20 [auto1.de] INFO: Scrape type for EF19771: 0
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: RW04069
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: NJ07405
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ07405%27 HTTP/1.1" 200 None
2026-03-28 07:40:20 [auto1.de] INFO: Scrape type for NJ07405: 0
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: TM10455
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM10455%27 HTTP/1.1" 200 None
2026-03-28 07:40:20 [auto1.de] INFO: Scrape type for TM10455: 0
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: SY89352
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY89352%27 HTTP/1.1" 200 None
2026-03-28 07:40:20 [auto1.de] INFO: Scrape type for SY89352: 0
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: DM85685
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM85685%27 HTTP/1.1" 200 None
2026-03-28 07:40:20 [auto1.de] INFO: Scrape type for DM85685: 0
2026-03-28 07:40:20 [auto1.de] INFO: Found listing with ID: BU60385
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU60385%27 HTTP/1.1" 200 None
2026-03-28 07:40:20 [auto1.de] INFO: Scrape type for BU60385: 0
2026-03-28 07:40:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:21 [auto1.de] INFO: Channel: 24h | Page: 145 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: EU26166
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU26166%27 HTTP/1.1" 200 None
2026-03-28 07:40:21 [auto1.de] INFO: Scrape type for EU26166: 0
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: GS88086
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS88086%27 HTTP/1.1" 200 None
2026-03-28 07:40:21 [auto1.de] INFO: Scrape type for GS88086: 0
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: UH92417
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH92417%27 HTTP/1.1" 200 None
2026-03-28 07:40:21 [auto1.de] INFO: Scrape type for UH92417: 0
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: XV57552
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: ZF36287
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF36287%27 HTTP/1.1" 200 None
2026-03-28 07:40:21 [auto1.de] INFO: Scrape type for ZF36287: 0
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: UY49029
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: JE28257
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE28257%27 HTTP/1.1" 200 None
2026-03-28 07:40:21 [auto1.de] INFO: Scrape type for JE28257: 0
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: FY17492
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY17492%27 HTTP/1.1" 200 None
2026-03-28 07:40:21 [auto1.de] INFO: Scrape type for FY17492: 0
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: PB03709
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: MT89119
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT89119%27 HTTP/1.1" 200 None
2026-03-28 07:40:21 [auto1.de] INFO: Scrape type for MT89119: 0
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: FS23827
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: EL23730
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: TY40136
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: LB55068
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB55068%27 HTTP/1.1" 200 None
2026-03-28 07:40:21 [auto1.de] INFO: Scrape type for LB55068: 0
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: AU82814
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU82814%27 HTTP/1.1" 200 None
2026-03-28 07:40:21 [auto1.de] INFO: Scrape type for AU82814: 0
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: EV33886
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: DH53095
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: TM91896
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: ES20702
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: BR66744
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR66744%27 HTTP/1.1" 200 None
2026-03-28 07:40:21 [auto1.de] INFO: Scrape type for BR66744: 0
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: SY93073
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: XE28025
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: LB14503
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB14503%27 HTTP/1.1" 200 None
2026-03-28 07:40:21 [auto1.de] INFO: Scrape type for LB14503: 0
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: DF28999
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF28999%27 HTTP/1.1" 200 None
2026-03-28 07:40:21 [auto1.de] INFO: Scrape type for DF28999: 0
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: KU56526
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: PT66739
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT66739%27 HTTP/1.1" 200 None
2026-03-28 07:40:21 [auto1.de] INFO: Scrape type for PT66739: 0
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: UL11203
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL11203%27 HTTP/1.1" 200 None
2026-03-28 07:40:21 [auto1.de] INFO: Scrape type for UL11203: 0
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: MK93250
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK93250%27 HTTP/1.1" 200 None
2026-03-28 07:40:21 [auto1.de] INFO: Scrape type for MK93250: 0
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: SM85227
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: CG03839
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG03839%27 HTTP/1.1" 200 None
2026-03-28 07:40:21 [auto1.de] INFO: Scrape type for CG03839: 0
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: VJ55974
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ55974%27 HTTP/1.1" 200 None
2026-03-28 07:40:21 [auto1.de] INFO: Scrape type for VJ55974: 0
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: YJ11714
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: NV96108
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV96108%27 HTTP/1.1" 200 None
2026-03-28 07:40:21 [auto1.de] INFO: Scrape type for NV96108: 0
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: VY22890
2026-03-28 07:40:21 [auto1.de] INFO: Found listing with ID: UJ07162
2026-03-28 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ07162%27 HTTP/1.1" 200 None
2026-03-28 07:40:22 [auto1.de] INFO: Scrape type for UJ07162: 0
2026-03-28 07:40:22 [auto1.de] INFO: Found listing with ID: XR81453
2026-03-28 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR81453%27 HTTP/1.1" 200 None
2026-03-28 07:40:22 [auto1.de] INFO: Scrape type for XR81453: 0
2026-03-28 07:40:22 [auto1.de] INFO: Found listing with ID: DS58679
2026-03-28 07:40:22 [auto1.de] INFO: Found listing with ID: MN24694
2026-03-28 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN24694%27 HTTP/1.1" 200 None
2026-03-28 07:40:22 [auto1.de] INFO: Scrape type for MN24694: 0
2026-03-28 07:40:22 [auto1.de] INFO: Found listing with ID: PL85371
2026-03-28 07:40:22 [auto1.de] INFO: Found listing with ID: PU44230
2026-03-28 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU44230%27 HTTP/1.1" 200 None
2026-03-28 07:40:22 [auto1.de] INFO: Scrape type for PU44230: 0
2026-03-28 07:40:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:23 [auto1.de] INFO: Channel: 24h | Page: 146 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: VL80954
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL80954%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for VL80954: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: ZE45705
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE45705%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for ZE45705: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: DE08744
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE08744%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for DE08744: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: EN22144
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN22144%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for EN22144: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: EC78476
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC78476%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for EC78476: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: LA72906
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA72906%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for LA72906: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: MF16009
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: WK49027
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK49027%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for WK49027: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: KG21612
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: YV29892
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: WZ80010
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ80010%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for WZ80010: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: CC70262
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC70262%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for CC70262: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: TK71200
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK71200%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for TK71200: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: DV15520
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV15520%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for DV15520: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: UP12343
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP12343%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for UP12343: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: CT94694
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT94694%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for CT94694: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: KY11260
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: VV43208
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV43208%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for VV43208: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: KL57981
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: CU33421
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU33421%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for CU33421: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: PF93593
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF93593%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for PF93593: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: AK88220
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: KS12992
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS12992%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for KS12992: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: FH56262
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: WC31038
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC31038%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for WC31038: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: MG09905
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG09905%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for MG09905: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: MT78692
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: XC13487
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC13487%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for XC13487: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: EZ46252
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ46252%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for EZ46252: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: LS44265
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: KD58874
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD58874%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for KD58874: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: TC94851
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC94851%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for TC94851: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: TM61103
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM61103%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for TM61103: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: KT77585
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: XB19891
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB19891%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for XB19891: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: TJ66673
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ66673%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for TJ66673: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: CX98688
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: DH53166
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH53166%27 HTTP/1.1" 200 None
2026-03-28 07:40:23 [auto1.de] INFO: Scrape type for DH53166: 0
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: ZE31778
2026-03-28 07:40:23 [auto1.de] INFO: Found listing with ID: RD12421
2026-03-28 07:40:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:25 [auto1.de] INFO: Channel: 24h | Page: 147 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: SA82708
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: RJ07463
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ07463%27 HTTP/1.1" 200 None
2026-03-28 07:40:25 [auto1.de] INFO: Scrape type for RJ07463: 0
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: NH92244
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH92244%27 HTTP/1.1" 200 None
2026-03-28 07:40:25 [auto1.de] INFO: Scrape type for NH92244: 0
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: GE45533
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: GU99476
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: HF74785
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF74785%27 HTTP/1.1" 200 None
2026-03-28 07:40:25 [auto1.de] INFO: Scrape type for HF74785: 0
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: HA43942
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA43942%27 HTTP/1.1" 200 None
2026-03-28 07:40:25 [auto1.de] INFO: Scrape type for HA43942: 0
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: CZ70893
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: EZ84115
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: CF13145
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF13145%27 HTTP/1.1" 200 None
2026-03-28 07:40:25 [auto1.de] INFO: Scrape type for CF13145: 0
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: EG69699
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG69699%27 HTTP/1.1" 200 None
2026-03-28 07:40:25 [auto1.de] INFO: Scrape type for EG69699: 0
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: LZ69181
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ69181%27 HTTP/1.1" 200 None
2026-03-28 07:40:25 [auto1.de] INFO: Scrape type for LZ69181: 0
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: BC55078
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC55078%27 HTTP/1.1" 200 None
2026-03-28 07:40:25 [auto1.de] INFO: Scrape type for BC55078: 0
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: RL63795
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: WG13195
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG13195%27 HTTP/1.1" 200 None
2026-03-28 07:40:25 [auto1.de] INFO: Scrape type for WG13195: 0
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: NT25501
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: CM64848
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: US44062
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US44062%27 HTTP/1.1" 200 None
2026-03-28 07:40:25 [auto1.de] INFO: Scrape type for US44062: 0
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: GP45415
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP45415%27 HTTP/1.1" 200 None
2026-03-28 07:40:25 [auto1.de] INFO: Scrape type for GP45415: 0
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: PA16133
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: TD01616
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD01616%27 HTTP/1.1" 200 None
2026-03-28 07:40:25 [auto1.de] INFO: Scrape type for TD01616: 0
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: YV04916
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV04916%27 HTTP/1.1" 200 None
2026-03-28 07:40:25 [auto1.de] INFO: Scrape type for YV04916: 0
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: ES00815
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES00815%27 HTTP/1.1" 200 None
2026-03-28 07:40:25 [auto1.de] INFO: Scrape type for ES00815: 0
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: RP66782
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP66782%27 HTTP/1.1" 200 None
2026-03-28 07:40:25 [auto1.de] INFO: Scrape type for RP66782: 0
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: VJ82092
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: EZ87167
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ87167%27 HTTP/1.1" 200 None
2026-03-28 07:40:25 [auto1.de] INFO: Scrape type for EZ87167: 0
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: AB91886
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: VK49169
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: AZ86702
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: FZ73081
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: NG98905
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: ZZ70477
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ70477%27 HTTP/1.1" 200 None
2026-03-28 07:40:25 [auto1.de] INFO: Scrape type for ZZ70477: 0
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: FG85844
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG85844%27 HTTP/1.1" 200 None
2026-03-28 07:40:25 [auto1.de] INFO: Scrape type for FG85844: 0
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: FX17983
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: LE68165
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: XV51445
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: CP50790
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: UB05903
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: AY49158
2026-03-28 07:40:25 [auto1.de] INFO: Found listing with ID: NJ50287
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ50287%27 HTTP/1.1" 200 None
2026-03-28 07:40:25 [auto1.de] INFO: Scrape type for NJ50287: 0
2026-03-28 07:40:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:26 [auto1.de] INFO: Channel: 24h | Page: 148 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: NN96342
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: GX56948
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX56948%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for GX56948: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: MC19465
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC19465%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for MC19465: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: BK94626
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK94626%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for BK94626: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: ND36450
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: VB51991
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB51991%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for VB51991: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: NB13742
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: TH46997
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: EW90730
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW90730%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for EW90730: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: VN33107
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: EE21023
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE21023%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for EE21023: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: LC77518
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC77518%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for LC77518: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: CX63821
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX63821%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for CX63821: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: JL38639
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: DR68072
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR68072%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for DR68072: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: VN22748
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN22748%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for VN22748: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: GR03981
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR03981%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for GR03981: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: GD37496
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD37496%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for GD37496: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: AM26890
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM26890%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for AM26890: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: PU65266
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU65266%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for PU65266: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: PW54296
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW54296%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for PW54296: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: HU83271
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: ZB97674
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: FR08984
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR08984%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for FR08984: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: ZA36261
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA36261%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for ZA36261: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: RM05292
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: WC48972
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC48972%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for WC48972: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: UG40068
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG40068%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for UG40068: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: YG65181
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG65181%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for YG65181: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: GE28071
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE28071%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for GE28071: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: VL97959
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL97959%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for VL97959: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: XP39668
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP39668%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for XP39668: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: MS57219
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS57219%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for MS57219: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: TE02637
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: AJ02147
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: JW75364
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW75364%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for JW75364: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: BY93360
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY93360%27 HTTP/1.1" 200 None
2026-03-28 07:40:26 [auto1.de] INFO: Scrape type for BY93360: 0
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: LZ33123
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: UU98141
2026-03-28 07:40:26 [auto1.de] INFO: Found listing with ID: CK06472
2026-03-28 07:40:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:28 [auto1.de] INFO: Channel: 24h | Page: 149 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: DW18994
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW18994%27 HTTP/1.1" 200 None
2026-03-28 07:40:28 [auto1.de] INFO: Scrape type for DW18994: 0
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: TX71823
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX71823%27 HTTP/1.1" 200 None
2026-03-28 07:40:28 [auto1.de] INFO: Scrape type for TX71823: 0
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: SH29410
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH29410%27 HTTP/1.1" 200 None
2026-03-28 07:40:28 [auto1.de] INFO: Scrape type for SH29410: 0
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: PF77212
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: FP38925
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP38925%27 HTTP/1.1" 200 None
2026-03-28 07:40:28 [auto1.de] INFO: Scrape type for FP38925: 0
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: CU14126
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: FA52681
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA52681%27 HTTP/1.1" 200 None
2026-03-28 07:40:28 [auto1.de] INFO: Scrape type for FA52681: 0
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: HW74456
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: JF87432
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: AW42716
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW42716%27 HTTP/1.1" 200 None
2026-03-28 07:40:28 [auto1.de] INFO: Scrape type for AW42716: 0
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: YY97857
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY97857%27 HTTP/1.1" 200 None
2026-03-28 07:40:28 [auto1.de] INFO: Scrape type for YY97857: 0
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: PS70153
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS70153%27 HTTP/1.1" 200 None
2026-03-28 07:40:28 [auto1.de] INFO: Scrape type for PS70153: 0
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: ZT34226
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: TJ69662
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ69662%27 HTTP/1.1" 200 None
2026-03-28 07:40:28 [auto1.de] INFO: Scrape type for TJ69662: 0
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: EH70293
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: WE68456
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: GR93204
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: ME49426
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME49426%27 HTTP/1.1" 200 None
2026-03-28 07:40:28 [auto1.de] INFO: Scrape type for ME49426: 0
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: VH05156
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: AJ94093
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: ZE45367
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: KN83228
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN83228%27 HTTP/1.1" 200 None
2026-03-28 07:40:28 [auto1.de] INFO: Scrape type for KN83228: 0
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: SX49755
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: JW05859
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: ST09245
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: TE58325
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE58325%27 HTTP/1.1" 200 None
2026-03-28 07:40:28 [auto1.de] INFO: Scrape type for TE58325: 0
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: HD50866
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: PB84737
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB84737%27 HTTP/1.1" 200 None
2026-03-28 07:40:28 [auto1.de] INFO: Scrape type for PB84737: 0
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: FX80004
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX80004%27 HTTP/1.1" 200 None
2026-03-28 07:40:28 [auto1.de] INFO: Scrape type for FX80004: 0
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: CK93419
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK93419%27 HTTP/1.1" 200 None
2026-03-28 07:40:28 [auto1.de] INFO: Scrape type for CK93419: 0
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: EH26353
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: TT01449
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: RX36269
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: MS42398
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: NX20586
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: TY55277
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY55277%27 HTTP/1.1" 200 None
2026-03-28 07:40:28 [auto1.de] INFO: Scrape type for TY55277: 0
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: XA91710
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: SZ56060
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ56060%27 HTTP/1.1" 200 None
2026-03-28 07:40:28 [auto1.de] INFO: Scrape type for SZ56060: 0
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: CD69180
2026-03-28 07:40:28 [auto1.de] INFO: Found listing with ID: KD57513
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD57513%27 HTTP/1.1" 200 None
2026-03-28 07:40:28 [auto1.de] INFO: Scrape type for KD57513: 0
2026-03-28 07:40:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:29 [auto1.de] INFO: Channel: 24h | Page: 150 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: PD68131
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: CG73719
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG73719%27 HTTP/1.1" 200 None
2026-03-28 07:40:29 [auto1.de] INFO: Scrape type for CG73719: 0
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: LZ01049
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: GF81751
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: VY10328
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: RC78324
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: BK70800
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK70800%27 HTTP/1.1" 200 None
2026-03-28 07:40:29 [auto1.de] INFO: Scrape type for BK70800: 0
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: EN44355
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: TD91904
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD91904%27 HTTP/1.1" 200 None
2026-03-28 07:40:29 [auto1.de] INFO: Scrape type for TD91904: 0
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: VN58705
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: TE35535
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE35535%27 HTTP/1.1" 200 None
2026-03-28 07:40:29 [auto1.de] INFO: Scrape type for TE35535: 0
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: SX37933
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: GJ42738
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ42738%27 HTTP/1.1" 200 None
2026-03-28 07:40:29 [auto1.de] INFO: Scrape type for GJ42738: 0
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: ZE74585
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE74585%27 HTTP/1.1" 200 None
2026-03-28 07:40:29 [auto1.de] INFO: Scrape type for ZE74585: 0
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: VU37583
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: ZV29308
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV29308%27 HTTP/1.1" 200 None
2026-03-28 07:40:29 [auto1.de] INFO: Scrape type for ZV29308: 0
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: PA55939
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA55939%27 HTTP/1.1" 200 None
2026-03-28 07:40:29 [auto1.de] INFO: Scrape type for PA55939: 0
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: AM69365
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM69365%27 HTTP/1.1" 200 None
2026-03-28 07:40:29 [auto1.de] INFO: Scrape type for AM69365: 0
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: BH36406
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: FP71706
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: VV17039
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV17039%27 HTTP/1.1" 200 None
2026-03-28 07:40:29 [auto1.de] INFO: Scrape type for VV17039: 0
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: MY28321
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY28321%27 HTTP/1.1" 200 None
2026-03-28 07:40:29 [auto1.de] INFO: Scrape type for MY28321: 0
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: FJ72456
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: RB37125
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: DX01361
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: GA16313
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: RC54937
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: BY26961
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY26961%27 HTTP/1.1" 200 None
2026-03-28 07:40:29 [auto1.de] INFO: Scrape type for BY26961: 0
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: PX99081
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: TB82704
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB82704%27 HTTP/1.1" 200 None
2026-03-28 07:40:29 [auto1.de] INFO: Scrape type for TB82704: 0
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: US61717
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: NV88353
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: KG05559
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: CM40362
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM40362%27 HTTP/1.1" 200 None
2026-03-28 07:40:29 [auto1.de] INFO: Scrape type for CM40362: 0
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: CG81314
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: CN28958
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: LK80095
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: KY35163
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: RW15562
2026-03-28 07:40:29 [auto1.de] INFO: Found listing with ID: PJ54145
2026-03-28 07:40:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:30 [auto1.de] INFO: Channel: 24h | Page: 151 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: AA47357
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: MX02891
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX02891%27 HTTP/1.1" 200 None
2026-03-28 07:40:30 [auto1.de] INFO: Scrape type for MX02891: 0
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: XU32794
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: NB97805
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: YG72803
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG72803%27 HTTP/1.1" 200 None
2026-03-28 07:40:30 [auto1.de] INFO: Scrape type for YG72803: 0
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: DE98094
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: AU97741
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU97741%27 HTTP/1.1" 200 None
2026-03-28 07:40:30 [auto1.de] INFO: Scrape type for AU97741: 0
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: XF94363
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: CD45301
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD45301%27 HTTP/1.1" 200 None
2026-03-28 07:40:30 [auto1.de] INFO: Scrape type for CD45301: 0
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: GL30880
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL30880%27 HTTP/1.1" 200 None
2026-03-28 07:40:30 [auto1.de] INFO: Scrape type for GL30880: 0
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: XX31179
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX31179%27 HTTP/1.1" 200 None
2026-03-28 07:40:30 [auto1.de] INFO: Scrape type for XX31179: 0
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: TM06695
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM06695%27 HTTP/1.1" 200 None
2026-03-28 07:40:30 [auto1.de] INFO: Scrape type for TM06695: 0
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: YP61369
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP61369%27 HTTP/1.1" 200 None
2026-03-28 07:40:30 [auto1.de] INFO: Scrape type for YP61369: 0
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: GY23917
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: YW34309
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: TL68134
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL68134%27 HTTP/1.1" 200 None
2026-03-28 07:40:30 [auto1.de] INFO: Scrape type for TL68134: 0
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: SN72199
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN72199%27 HTTP/1.1" 200 None
2026-03-28 07:40:30 [auto1.de] INFO: Scrape type for SN72199: 0
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: ZX31727
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX31727%27 HTTP/1.1" 200 None
2026-03-28 07:40:30 [auto1.de] INFO: Scrape type for ZX31727: 0
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: NG69344
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: DL97595
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: KP81674
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP81674%27 HTTP/1.1" 200 None
2026-03-28 07:40:30 [auto1.de] INFO: Scrape type for KP81674: 0
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: UK08756
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: BT49963
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: GN37925
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: TG58212
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: ST20646
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST20646%27 HTTP/1.1" 200 None
2026-03-28 07:40:30 [auto1.de] INFO: Scrape type for ST20646: 0
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: UF64612
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: TP96640
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP96640%27 HTTP/1.1" 200 None
2026-03-28 07:40:30 [auto1.de] INFO: Scrape type for TP96640: 0
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: LF59427
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF59427%27 HTTP/1.1" 200 None
2026-03-28 07:40:30 [auto1.de] INFO: Scrape type for LF59427: 0
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: DT28740
2026-03-28 07:40:30 [auto1.de] INFO: Found listing with ID: KP87344
2026-03-28 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP87344%27 HTTP/1.1" 200 None
2026-03-28 07:40:31 [auto1.de] INFO: Scrape type for KP87344: 0
2026-03-28 07:40:31 [auto1.de] INFO: Found listing with ID: LL25204
2026-03-28 07:40:31 [auto1.de] INFO: Found listing with ID: VL21879
2026-03-28 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL21879%27 HTTP/1.1" 200 None
2026-03-28 07:40:31 [auto1.de] INFO: Scrape type for VL21879: 0
2026-03-28 07:40:31 [auto1.de] INFO: Found listing with ID: US56502
2026-03-28 07:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US56502%27 HTTP/1.1" 200 None
2026-03-28 07:40:32 [auto1.de] INFO: Scrape type for US56502: 0
2026-03-28 07:40:32 [auto1.de] INFO: Found listing with ID: NW02543
2026-03-28 07:40:32 [auto1.de] INFO: Found listing with ID: CD56647
2026-03-28 07:40:32 [auto1.de] INFO: Found listing with ID: GT58505
2026-03-28 07:40:32 [auto1.de] INFO: Found listing with ID: VL79730
2026-03-28 07:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL79730%27 HTTP/1.1" 200 None
2026-03-28 07:40:32 [auto1.de] INFO: Scrape type for VL79730: 0
2026-03-28 07:40:32 [auto1.de] INFO: Found listing with ID: AD82327
2026-03-28 07:40:32 [auto1.de] INFO: Found listing with ID: XZ96543
2026-03-28 07:40:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:33 [auto1.de] INFO: Channel: 24h | Page: 152 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: CK84470
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK84470%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for CK84470: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: GH92253
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH92253%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for GH92253: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: PW77910
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: MC27977
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC27977%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for MC27977: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: AY73359
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY73359%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for AY73359: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: KE33032
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: BZ78567
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ78567%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for BZ78567: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: DP54088
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP54088%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for DP54088: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: PF90530
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF90530%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for PF90530: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: LZ21667
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: KD99837
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD99837%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for KD99837: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: EP50641
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: MX37955
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: JT79226
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT79226%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for JT79226: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: SX95086
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX95086%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for SX95086: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: LX99570
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX99570%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for LX99570: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: GE53934
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: LA20568
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: MH37188
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH37188%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for MH37188: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: JH92340
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH92340%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for JH92340: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: TR16166
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR16166%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for TR16166: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: VF41212
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF41212%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for VF41212: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: KJ60236
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ60236%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for KJ60236: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: PW80627
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW80627%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for PW80627: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: UH10138
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH10138%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for UH10138: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: MA09266
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA09266%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for MA09266: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: NM81365
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: CR14297
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR14297%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for CR14297: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: HL19525
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL19525%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for HL19525: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: TE89273
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE89273%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for TE89273: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: KT58980
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT58980%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for KT58980: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: CK35752
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK35752%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for CK35752: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: EC58383
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC58383%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for EC58383: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: ZB00511
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: WT11127
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: CE50485
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: RH01499
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: CG17958
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG17958%27 HTTP/1.1" 200 None
2026-03-28 07:40:33 [auto1.de] INFO: Scrape type for CG17958: 0
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: TA01752
2026-03-28 07:40:33 [auto1.de] INFO: Found listing with ID: HD36706
2026-03-28 07:40:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:34 [auto1.de] INFO: Channel: 24h | Page: 153 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:34 [auto1.de] INFO: Found listing with ID: FJ91980
2026-03-28 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ91980%27 HTTP/1.1" 200 None
2026-03-28 07:40:34 [auto1.de] INFO: Scrape type for FJ91980: 0
2026-03-28 07:40:34 [auto1.de] INFO: Found listing with ID: EY40312
2026-03-28 07:40:34 [auto1.de] INFO: Found listing with ID: GH14315
2026-03-28 07:40:34 [auto1.de] INFO: Found listing with ID: LZ35604
2026-03-28 07:40:34 [auto1.de] INFO: Found listing with ID: WE09551
2026-03-28 07:40:34 [auto1.de] INFO: Found listing with ID: YH89346
2026-03-28 07:40:34 [auto1.de] INFO: Found listing with ID: DT18968
2026-03-28 07:40:34 [auto1.de] INFO: Found listing with ID: NL93445
2026-03-28 07:40:34 [auto1.de] INFO: Found listing with ID: WF57615
2026-03-28 07:40:34 [auto1.de] INFO: Found listing with ID: AU06987
2026-03-28 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU06987%27 HTTP/1.1" 200 None
2026-03-28 07:40:34 [auto1.de] INFO: Scrape type for AU06987: 0
2026-03-28 07:40:34 [auto1.de] INFO: Found listing with ID: VP02166
2026-03-28 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP02166%27 HTTP/1.1" 200 None
2026-03-28 07:40:34 [auto1.de] INFO: Scrape type for VP02166: 0
2026-03-28 07:40:34 [auto1.de] INFO: Found listing with ID: CR38354
2026-03-28 07:40:34 [auto1.de] INFO: Found listing with ID: NK84600
2026-03-28 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK84600%27 HTTP/1.1" 200 None
2026-03-28 07:40:34 [auto1.de] INFO: Scrape type for NK84600: 0
2026-03-28 07:40:34 [auto1.de] INFO: Found listing with ID: KD59460
2026-03-28 07:40:34 [auto1.de] INFO: Found listing with ID: VS42918
2026-03-28 07:40:34 [auto1.de] INFO: Found listing with ID: AN41725
2026-03-28 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN41725%27 HTTP/1.1" 200 None
2026-03-28 07:40:34 [auto1.de] INFO: Scrape type for AN41725: 0
2026-03-28 07:40:34 [auto1.de] INFO: Found listing with ID: NK67833
2026-03-28 07:40:34 [auto1.de] INFO: Found listing with ID: LL85069
2026-03-28 07:40:34 [auto1.de] INFO: Found listing with ID: UC57196
2026-03-28 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC57196%27 HTTP/1.1" 200 None
2026-03-28 07:40:34 [auto1.de] INFO: Scrape type for UC57196: 0
2026-03-28 07:40:34 [auto1.de] INFO: Found listing with ID: SA39123
2026-03-28 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA39123%27 HTTP/1.1" 200 None
2026-03-28 07:40:34 [auto1.de] INFO: Scrape type for SA39123: 0
2026-03-28 07:40:34 [auto1.de] INFO: Found listing with ID: NN27576
2026-03-28 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN27576%27 HTTP/1.1" 200 None
2026-03-28 07:40:35 [auto1.de] INFO: Scrape type for NN27576: 0
2026-03-28 07:40:35 [auto1.de] INFO: Found listing with ID: KB43733
2026-03-28 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB43733%27 HTTP/1.1" 200 None
2026-03-28 07:40:35 [auto1.de] INFO: Scrape type for KB43733: 0
2026-03-28 07:40:35 [auto1.de] INFO: Found listing with ID: CM27166
2026-03-28 07:40:35 [auto1.de] INFO: Found listing with ID: NX98593
2026-03-28 07:40:35 [auto1.de] INFO: Found listing with ID: RC01446
2026-03-28 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC01446%27 HTTP/1.1" 200 None
2026-03-28 07:40:35 [auto1.de] INFO: Scrape type for RC01446: 0
2026-03-28 07:40:35 [auto1.de] INFO: Found listing with ID: BR53906
2026-03-28 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR53906%27 HTTP/1.1" 200 None
2026-03-28 07:40:35 [auto1.de] INFO: Scrape type for BR53906: 0
2026-03-28 07:40:35 [auto1.de] INFO: Found listing with ID: FH89031
2026-03-28 07:40:35 [auto1.de] INFO: Found listing with ID: NZ17394
2026-03-28 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ17394%27 HTTP/1.1" 200 None
2026-03-28 07:40:35 [auto1.de] INFO: Scrape type for NZ17394: 0
2026-03-28 07:40:35 [auto1.de] INFO: Found listing with ID: BC97155
2026-03-28 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC97155%27 HTTP/1.1" 200 None
2026-03-28 07:40:35 [auto1.de] INFO: Scrape type for BC97155: 0
2026-03-28 07:40:35 [auto1.de] INFO: Found listing with ID: UK22144
2026-03-28 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK22144%27 HTTP/1.1" 200 None
2026-03-28 07:40:35 [auto1.de] INFO: Scrape type for UK22144: 0
2026-03-28 07:40:35 [auto1.de] INFO: Found listing with ID: ET59047
2026-03-28 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET59047%27 HTTP/1.1" 200 None
2026-03-28 07:40:35 [auto1.de] INFO: Scrape type for ET59047: 0
2026-03-28 07:40:35 [auto1.de] INFO: Found listing with ID: PA37640
2026-03-28 07:40:35 [auto1.de] INFO: Found listing with ID: MW91844
2026-03-28 07:40:35 [auto1.de] INFO: Found listing with ID: GZ31172
2026-03-28 07:40:35 [auto1.de] INFO: Found listing with ID: JM75105
2026-03-28 07:40:35 [auto1.de] INFO: Found listing with ID: HF90366
2026-03-28 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF90366%27 HTTP/1.1" 200 None
2026-03-28 07:40:35 [auto1.de] INFO: Scrape type for HF90366: 0
2026-03-28 07:40:35 [auto1.de] INFO: Found listing with ID: BY55773
2026-03-28 07:40:35 [auto1.de] INFO: Found listing with ID: LK57137
2026-03-28 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK57137%27 HTTP/1.1" 200 None
2026-03-28 07:40:35 [auto1.de] INFO: Scrape type for LK57137: 0
2026-03-28 07:40:35 [auto1.de] INFO: Found listing with ID: MK56565
2026-03-28 07:40:35 [auto1.de] INFO: Found listing with ID: NE52715
2026-03-28 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE52715%27 HTTP/1.1" 200 None
2026-03-28 07:40:35 [auto1.de] INFO: Scrape type for NE52715: 0
2026-03-28 07:40:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:36 [auto1.de] INFO: Channel: 24h | Page: 154 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: NA93795
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: UK09737
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: EU93663
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: GZ30709
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ30709%27 HTTP/1.1" 200 None
2026-03-28 07:40:36 [auto1.de] INFO: Scrape type for GZ30709: 0
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: BD99191
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: GP19513
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: YT13980
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: UF84610
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF84610%27 HTTP/1.1" 200 None
2026-03-28 07:40:36 [auto1.de] INFO: Scrape type for UF84610: 0
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: DT85879
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT85879%27 HTTP/1.1" 200 None
2026-03-28 07:40:36 [auto1.de] INFO: Scrape type for DT85879: 0
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: SA59196
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: WN39495
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: DZ81579
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ81579%27 HTTP/1.1" 200 None
2026-03-28 07:40:36 [auto1.de] INFO: Scrape type for DZ81579: 0
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: FN92851
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN92851%27 HTTP/1.1" 200 None
2026-03-28 07:40:36 [auto1.de] INFO: Scrape type for FN92851: 0
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: CV09356
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: SG08144
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG08144%27 HTTP/1.1" 200 None
2026-03-28 07:40:36 [auto1.de] INFO: Scrape type for SG08144: 0
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: ML18265
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: RT17429
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT17429%27 HTTP/1.1" 200 None
2026-03-28 07:40:36 [auto1.de] INFO: Scrape type for RT17429: 0
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: YR51740
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: CN48396
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: MX70218
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: XJ83535
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: YT47398
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: XR62561
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: FF27762
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: HJ04828
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: VM53714
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: YY58464
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: YM89123
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM89123%27 HTTP/1.1" 200 None
2026-03-28 07:40:36 [auto1.de] INFO: Scrape type for YM89123: 0
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: ZM52655
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM52655%27 HTTP/1.1" 200 None
2026-03-28 07:40:36 [auto1.de] INFO: Scrape type for ZM52655: 0
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: AM53740
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM53740%27 HTTP/1.1" 200 None
2026-03-28 07:40:36 [auto1.de] INFO: Scrape type for AM53740: 0
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: EM43051
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: FF42926
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF42926%27 HTTP/1.1" 200 None
2026-03-28 07:40:36 [auto1.de] INFO: Scrape type for FF42926: 0
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: WZ42381
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: TR57045
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR57045%27 HTTP/1.1" 200 None
2026-03-28 07:40:36 [auto1.de] INFO: Scrape type for TR57045: 0
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: FK33509
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK33509%27 HTTP/1.1" 200 None
2026-03-28 07:40:36 [auto1.de] INFO: Scrape type for FK33509: 0
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: XB91859
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB91859%27 HTTP/1.1" 200 None
2026-03-28 07:40:36 [auto1.de] INFO: Scrape type for XB91859: 0
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: WM35972
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: BY51393
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: LP84561
2026-03-28 07:40:36 [auto1.de] INFO: Found listing with ID: ED54075
2026-03-28 07:40:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:40 [auto1.de] INFO: Channel: 24h | Page: 155 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: GS01911
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: RD90808
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: CH79941
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH79941%27 HTTP/1.1" 200 None
2026-03-28 07:40:40 [auto1.de] INFO: Scrape type for CH79941: 0
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: MU86214
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU86214%27 HTTP/1.1" 200 None
2026-03-28 07:40:40 [auto1.de] INFO: Scrape type for MU86214: 0
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: DK79319
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: XJ84301
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ84301%27 HTTP/1.1" 200 None
2026-03-28 07:40:40 [auto1.de] INFO: Scrape type for XJ84301: 0
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: HL01818
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL01818%27 HTTP/1.1" 200 None
2026-03-28 07:40:40 [auto1.de] INFO: Scrape type for HL01818: 0
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: ND71699
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: PK53003
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: VR97101
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: ZN05925
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: PZ10151
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: HB70808
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB70808%27 HTTP/1.1" 200 None
2026-03-28 07:40:40 [auto1.de] INFO: Scrape type for HB70808: 0
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: BM26089
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: SK51641
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK51641%27 HTTP/1.1" 200 None
2026-03-28 07:40:40 [auto1.de] INFO: Scrape type for SK51641: 0
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: UF17826
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: XH45962
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH45962%27 HTTP/1.1" 200 None
2026-03-28 07:40:40 [auto1.de] INFO: Scrape type for XH45962: 0
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: ME71615
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME71615%27 HTTP/1.1" 200 None
2026-03-28 07:40:40 [auto1.de] INFO: Scrape type for ME71615: 0
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: TT01725
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT01725%27 HTTP/1.1" 200 None
2026-03-28 07:40:40 [auto1.de] INFO: Scrape type for TT01725: 0
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: JU24263
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: SA69574
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA69574%27 HTTP/1.1" 200 None
2026-03-28 07:40:40 [auto1.de] INFO: Scrape type for SA69574: 0
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: VW79588
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW79588%27 HTTP/1.1" 200 None
2026-03-28 07:40:40 [auto1.de] INFO: Scrape type for VW79588: 0
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: HP91359
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP91359%27 HTTP/1.1" 200 None
2026-03-28 07:40:40 [auto1.de] INFO: Scrape type for HP91359: 0
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: LF39104
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: WJ71458
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: YX12921
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX12921%27 HTTP/1.1" 200 None
2026-03-28 07:40:40 [auto1.de] INFO: Scrape type for YX12921: 0
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: TA42625
2026-03-28 07:40:40 [auto1.de] INFO: Found listing with ID: ML19559
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML19559%27 HTTP/1.1" 200 None
2026-03-28 07:40:40 [auto1.de] INFO: Scrape type for ML19559: 0
2026-03-28 07:40:41 [auto1.de] INFO: Found listing with ID: AA01467
2026-03-28 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA01467%27 HTTP/1.1" 200 None
2026-03-28 07:40:41 [auto1.de] INFO: Scrape type for AA01467: 0
2026-03-28 07:40:41 [auto1.de] INFO: Found listing with ID: HU29731
2026-03-28 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU29731%27 HTTP/1.1" 200 None
2026-03-28 07:40:41 [auto1.de] INFO: Scrape type for HU29731: 0
2026-03-28 07:40:41 [auto1.de] INFO: Found listing with ID: VD73221
2026-03-28 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD73221%27 HTTP/1.1" 200 None
2026-03-28 07:40:41 [auto1.de] INFO: Scrape type for VD73221: 0
2026-03-28 07:40:41 [auto1.de] INFO: Found listing with ID: VP85116
2026-03-28 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP85116%27 HTTP/1.1" 200 None
2026-03-28 07:40:41 [auto1.de] INFO: Scrape type for VP85116: 0
2026-03-28 07:40:41 [auto1.de] INFO: Found listing with ID: CP55762
2026-03-28 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP55762%27 HTTP/1.1" 200 None
2026-03-28 07:40:41 [auto1.de] INFO: Scrape type for CP55762: 0
2026-03-28 07:40:41 [auto1.de] INFO: Found listing with ID: GY64031
2026-03-28 07:40:41 [auto1.de] INFO: Found listing with ID: MD55722
2026-03-28 07:40:41 [auto1.de] INFO: Found listing with ID: GJ72052
2026-03-28 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ72052%27 HTTP/1.1" 200 None
2026-03-28 07:40:41 [auto1.de] INFO: Scrape type for GJ72052: 0
2026-03-28 07:40:41 [auto1.de] INFO: Found listing with ID: UK63230
2026-03-28 07:40:41 [auto1.de] INFO: Found listing with ID: RH48062
2026-03-28 07:40:41 [auto1.de] INFO: Found listing with ID: DH40869
2026-03-28 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH40869%27 HTTP/1.1" 200 None
2026-03-28 07:40:41 [auto1.de] INFO: Scrape type for DH40869: 0
2026-03-28 07:40:41 [auto1.de] INFO: Found listing with ID: PM25348
2026-03-28 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM25348%27 HTTP/1.1" 200 None
2026-03-28 07:40:41 [auto1.de] INFO: Scrape type for PM25348: 0
2026-03-28 07:40:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:42 [auto1.de] INFO: Channel: 24h | Page: 156 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: YE44037
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE44037%27 HTTP/1.1" 200 None
2026-03-28 07:40:42 [auto1.de] INFO: Scrape type for YE44037: 0
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: SN47860
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN47860%27 HTTP/1.1" 200 None
2026-03-28 07:40:42 [auto1.de] INFO: Scrape type for SN47860: 0
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: PH72669
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH72669%27 HTTP/1.1" 200 None
2026-03-28 07:40:42 [auto1.de] INFO: Scrape type for PH72669: 0
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: KW65379
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: RX15047
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX15047%27 HTTP/1.1" 200 None
2026-03-28 07:40:42 [auto1.de] INFO: Scrape type for RX15047: 0
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: RX80532
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX80532%27 HTTP/1.1" 200 None
2026-03-28 07:40:42 [auto1.de] INFO: Scrape type for RX80532: 0
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: SY58085
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY58085%27 HTTP/1.1" 200 None
2026-03-28 07:40:42 [auto1.de] INFO: Scrape type for SY58085: 0
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: XR52886
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: HL07149
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL07149%27 HTTP/1.1" 200 None
2026-03-28 07:40:42 [auto1.de] INFO: Scrape type for HL07149: 0
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: BZ60217
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: PV97095
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV97095%27 HTTP/1.1" 200 None
2026-03-28 07:40:42 [auto1.de] INFO: Scrape type for PV97095: 0
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: MA73958
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA73958%27 HTTP/1.1" 200 None
2026-03-28 07:40:42 [auto1.de] INFO: Scrape type for MA73958: 0
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: HW02228
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: XR27730
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: HL62100
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: SR36375
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR36375%27 HTTP/1.1" 200 None
2026-03-28 07:40:42 [auto1.de] INFO: Scrape type for SR36375: 0
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: TM98978
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: YM65091
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: WV10952
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: CR83846
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR83846%27 HTTP/1.1" 200 None
2026-03-28 07:40:42 [auto1.de] INFO: Scrape type for CR83846: 0
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: DX69622
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: LC93569
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC93569%27 HTTP/1.1" 200 None
2026-03-28 07:40:42 [auto1.de] INFO: Scrape type for LC93569: 0
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: ZL39165
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: LX80768
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: JX03592
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX03592%27 HTTP/1.1" 200 None
2026-03-28 07:40:42 [auto1.de] INFO: Scrape type for JX03592: 0
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: FP27450
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: WW45885
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: VH26233
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH26233%27 HTTP/1.1" 200 None
2026-03-28 07:40:42 [auto1.de] INFO: Scrape type for VH26233: 0
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: AF35013
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF35013%27 HTTP/1.1" 200 None
2026-03-28 07:40:42 [auto1.de] INFO: Scrape type for AF35013: 0
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: FW30112
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW30112%27 HTTP/1.1" 200 None
2026-03-28 07:40:42 [auto1.de] INFO: Scrape type for FW30112: 0
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: AY38359
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY38359%27 HTTP/1.1" 200 None
2026-03-28 07:40:42 [auto1.de] INFO: Scrape type for AY38359: 0
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: AM12190
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM12190%27 HTTP/1.1" 200 None
2026-03-28 07:40:42 [auto1.de] INFO: Scrape type for AM12190: 0
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: HH54610
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH54610%27 HTTP/1.1" 200 None
2026-03-28 07:40:42 [auto1.de] INFO: Scrape type for HH54610: 0
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: RJ67815
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: UG36008
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG36008%27 HTTP/1.1" 200 None
2026-03-28 07:40:42 [auto1.de] INFO: Scrape type for UG36008: 0
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: PD67762
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD67762%27 HTTP/1.1" 200 None
2026-03-28 07:40:42 [auto1.de] INFO: Scrape type for PD67762: 0
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: GH30720
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: ZY51606
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: DX86501
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX86501%27 HTTP/1.1" 200 None
2026-03-28 07:40:42 [auto1.de] INFO: Scrape type for DX86501: 0
2026-03-28 07:40:42 [auto1.de] INFO: Found listing with ID: RL99236
2026-03-28 07:40:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:44 [auto1.de] INFO: Channel: 24h | Page: 157 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: HJ28276
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: FF73158
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: FT91695
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: UF58190
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: YS34341
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS34341%27 HTTP/1.1" 200 None
2026-03-28 07:40:44 [auto1.de] INFO: Scrape type for YS34341: 0
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: SR10542
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: HE95833
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE95833%27 HTTP/1.1" 200 None
2026-03-28 07:40:44 [auto1.de] INFO: Scrape type for HE95833: 0
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: FW13122
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW13122%27 HTTP/1.1" 200 None
2026-03-28 07:40:44 [auto1.de] INFO: Scrape type for FW13122: 0
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: KJ72573
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ72573%27 HTTP/1.1" 200 None
2026-03-28 07:40:44 [auto1.de] INFO: Scrape type for KJ72573: 0
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: SN99491
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: KT36384
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT36384%27 HTTP/1.1" 200 None
2026-03-28 07:40:44 [auto1.de] INFO: Scrape type for KT36384: 0
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: EA89472
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: TV01596
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: VV90195
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: VV98956
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: RK85869
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: JG05380
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG05380%27 HTTP/1.1" 200 None
2026-03-28 07:40:44 [auto1.de] INFO: Scrape type for JG05380: 0
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: PJ72661
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ72661%27 HTTP/1.1" 200 None
2026-03-28 07:40:44 [auto1.de] INFO: Scrape type for PJ72661: 0
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: VT94173
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT94173%27 HTTP/1.1" 200 None
2026-03-28 07:40:44 [auto1.de] INFO: Scrape type for VT94173: 0
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: ZN65231
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: ET45765
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET45765%27 HTTP/1.1" 200 None
2026-03-28 07:40:44 [auto1.de] INFO: Scrape type for ET45765: 0
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: HT11802
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: NT28876
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: HD78649
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD78649%27 HTTP/1.1" 200 None
2026-03-28 07:40:44 [auto1.de] INFO: Scrape type for HD78649: 0
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: CW65482
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: TT83472
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: NP38313
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: WW82569
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: LV04533
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV04533%27 HTTP/1.1" 200 None
2026-03-28 07:40:44 [auto1.de] INFO: Scrape type for LV04533: 0
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: NF30454
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF30454%27 HTTP/1.1" 200 None
2026-03-28 07:40:44 [auto1.de] INFO: Scrape type for NF30454: 0
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: HJ88633
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: HZ95747
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: ZZ62402
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ62402%27 HTTP/1.1" 200 None
2026-03-28 07:40:44 [auto1.de] INFO: Scrape type for ZZ62402: 0
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: VP46416
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: UR28246
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: LK46158
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: GN50102
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN50102%27 HTTP/1.1" 200 None
2026-03-28 07:40:44 [auto1.de] INFO: Scrape type for GN50102: 0
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: HL48230
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL48230%27 HTTP/1.1" 200 None
2026-03-28 07:40:44 [auto1.de] INFO: Scrape type for HL48230: 0
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: WE47362
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE47362%27 HTTP/1.1" 200 None
2026-03-28 07:40:44 [auto1.de] INFO: Scrape type for WE47362: 0
2026-03-28 07:40:44 [auto1.de] INFO: Found listing with ID: KX24569
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24569%27 HTTP/1.1" 200 None
2026-03-28 07:40:44 [auto1.de] INFO: Scrape type for KX24569: 0
2026-03-28 07:40:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:45 [auto1.de] INFO: Channel: 24h | Page: 158 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: BP64224
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP64224%27 HTTP/1.1" 200 None
2026-03-28 07:40:45 [auto1.de] INFO: Scrape type for BP64224: 0
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: VX99653
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX99653%27 HTTP/1.1" 200 None
2026-03-28 07:40:45 [auto1.de] INFO: Scrape type for VX99653: 0
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: DN57570
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN57570%27 HTTP/1.1" 200 None
2026-03-28 07:40:45 [auto1.de] INFO: Scrape type for DN57570: 0
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: VG01076
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG01076%27 HTTP/1.1" 200 None
2026-03-28 07:40:45 [auto1.de] INFO: Scrape type for VG01076: 0
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: RF69391
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: TM25044
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM25044%27 HTTP/1.1" 200 None
2026-03-28 07:40:45 [auto1.de] INFO: Scrape type for TM25044: 0
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: JE81559
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE81559%27 HTTP/1.1" 200 None
2026-03-28 07:40:45 [auto1.de] INFO: Scrape type for JE81559: 0
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: AR87592
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: KR15708
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR15708%27 HTTP/1.1" 200 None
2026-03-28 07:40:45 [auto1.de] INFO: Scrape type for KR15708: 0
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: DT53290
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: LJ25483
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ25483%27 HTTP/1.1" 200 None
2026-03-28 07:40:45 [auto1.de] INFO: Scrape type for LJ25483: 0
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: US86443
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US86443%27 HTTP/1.1" 200 None
2026-03-28 07:40:45 [auto1.de] INFO: Scrape type for US86443: 0
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: SZ20099
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: ZE29906
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE29906%27 HTTP/1.1" 200 None
2026-03-28 07:40:45 [auto1.de] INFO: Scrape type for ZE29906: 0
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: BJ34801
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: LM23277
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: VM20095
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: BH43917
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: WA68038
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68038%27 HTTP/1.1" 200 None
2026-03-28 07:40:45 [auto1.de] INFO: Scrape type for WA68038: 0
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: TX92076
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: UR24224
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: TC39973
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC39973%27 HTTP/1.1" 200 None
2026-03-28 07:40:45 [auto1.de] INFO: Scrape type for TC39973: 0
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: MH02928
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: AL93555
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL93555%27 HTTP/1.1" 200 None
2026-03-28 07:40:45 [auto1.de] INFO: Scrape type for AL93555: 0
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: UT28734
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: YX67220
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX67220%27 HTTP/1.1" 200 None
2026-03-28 07:40:45 [auto1.de] INFO: Scrape type for YX67220: 0
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: VG38985
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: CC63606
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: SN95717
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN95717%27 HTTP/1.1" 200 None
2026-03-28 07:40:45 [auto1.de] INFO: Scrape type for SN95717: 0
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: ZF91540
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF91540%27 HTTP/1.1" 200 None
2026-03-28 07:40:45 [auto1.de] INFO: Scrape type for ZF91540: 0
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: DR38241
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR38241%27 HTTP/1.1" 200 None
2026-03-28 07:40:45 [auto1.de] INFO: Scrape type for DR38241: 0
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: GU49323
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: SY49649
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: HS03842
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS03842%27 HTTP/1.1" 200 None
2026-03-28 07:40:45 [auto1.de] INFO: Scrape type for HS03842: 0
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: KD34962
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD34962%27 HTTP/1.1" 200 None
2026-03-28 07:40:45 [auto1.de] INFO: Scrape type for KD34962: 0
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: EA35621
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: KH16310
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH16310%27 HTTP/1.1" 200 None
2026-03-28 07:40:45 [auto1.de] INFO: Scrape type for KH16310: 0
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: SP41663
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41663%27 HTTP/1.1" 200 None
2026-03-28 07:40:45 [auto1.de] INFO: Scrape type for SP41663: 0
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: SZ38457
2026-03-28 07:40:45 [auto1.de] INFO: Found listing with ID: FR65686
2026-03-28 07:40:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:57 [auto1.de] INFO: Channel: 24h | Page: 159 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: ZP95286
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: SW23111
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW23111%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for SW23111: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: DB64209
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: XG90247
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG90247%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for XG90247: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: LM03290
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM03290%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for LM03290: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: HR57506
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR57506%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for HR57506: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: DC59357
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC59357%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for DC59357: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: VY52691
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY52691%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for VY52691: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: CD93100
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD93100%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for CD93100: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: KX12116
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX12116%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for KX12116: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: RB85475
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB85475%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for RB85475: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: HF07638
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: RC80403
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC80403%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for RC80403: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: PE55813
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: KN40291
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN40291%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for KN40291: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: MD44435
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD44435%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for MD44435: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: EP13780
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP13780%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for EP13780: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: FE02336
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: UN96808
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: ST89847
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST89847%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for ST89847: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: FK17094
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: AV93240
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV93240%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for AV93240: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: RC04315
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC04315%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for RC04315: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: WG41390
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG41390%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for WG41390: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: GY29041
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY29041%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for GY29041: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: NB41059
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB41059%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for NB41059: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: ZS85358
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: JG67628
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG67628%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for JG67628: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: EY00431
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: MH70992
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: PM92730
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: YC14273
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC14273%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for YC14273: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: MX11435
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: PK93112
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK93112%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for PK93112: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: AE93045
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE93045%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for AE93045: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: AD73380
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD73380%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for AD73380: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: UD03401
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD03401%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for UD03401: 0
2026-03-28 07:40:57 [auto1.de] INFO: Found listing with ID: PW74632
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW74632%27 HTTP/1.1" 200 None
2026-03-28 07:40:57 [auto1.de] INFO: Scrape type for PW74632: 0
2026-03-28 07:40:58 [auto1.de] INFO: Found listing with ID: RR46383
2026-03-28 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR46383%27 HTTP/1.1" 200 None
2026-03-28 07:40:58 [auto1.de] INFO: Scrape type for RR46383: 0
2026-03-28 07:40:58 [auto1.de] INFO: Found listing with ID: CF55359
2026-03-28 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF55359%27 HTTP/1.1" 200 None
2026-03-28 07:40:58 [auto1.de] INFO: Scrape type for CF55359: 0
2026-03-28 07:40:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:40:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:40:59 [auto1.de] INFO: Channel: 24h | Page: 160 | totalHits: 9263 | hits on page: 40
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: BH53134
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: BB14997
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: KU21621
2026-03-28 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU21621%27 HTTP/1.1" 200 None
2026-03-28 07:40:59 [auto1.de] INFO: Scrape type for KU21621: 0
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: SX94588
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: AF24484
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: GA25019
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: PY88606
2026-03-28 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88606%27 HTTP/1.1" 200 None
2026-03-28 07:40:59 [auto1.de] INFO: Scrape type for PY88606: 0
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: XY13260
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: CU80256
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: FU04810
2026-03-28 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU04810%27 HTTP/1.1" 200 None
2026-03-28 07:40:59 [auto1.de] INFO: Scrape type for FU04810: 0
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: WC63279
2026-03-28 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63279%27 HTTP/1.1" 200 None
2026-03-28 07:40:59 [auto1.de] INFO: Scrape type for WC63279: 0
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: WC13471
2026-03-28 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC13471%27 HTTP/1.1" 200 None
2026-03-28 07:40:59 [auto1.de] INFO: Scrape type for WC13471: 0
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: JU65331
2026-03-28 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU65331%27 HTTP/1.1" 200 None
2026-03-28 07:40:59 [auto1.de] INFO: Scrape type for JU65331: 0
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: TD57805
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: BG37163
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: CS21396
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: SM01273
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: TC06569
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: MW24531
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: ZS56665
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: AU39005
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: MC98877
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: JB91178
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: XC03196
2026-03-28 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC03196%27 HTTP/1.1" 200 None
2026-03-28 07:40:59 [auto1.de] INFO: Scrape type for XC03196: 0
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: XP56939
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: BJ97003
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: LM23776
2026-03-28 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM23776%27 HTTP/1.1" 200 None
2026-03-28 07:40:59 [auto1.de] INFO: Scrape type for LM23776: 0
2026-03-28 07:40:59 [auto1.de] INFO: Found listing with ID: HB72145
2026-03-28 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB72145%27 HTTP/1.1" 200 None
2026-03-28 07:41:00 [auto1.de] INFO: Scrape type for HB72145: 0
2026-03-28 07:41:00 [auto1.de] INFO: Found listing with ID: DR63212
2026-03-28 07:41:00 [auto1.de] INFO: Found listing with ID: JX94750
2026-03-28 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX94750%27 HTTP/1.1" 200 None
2026-03-28 07:41:00 [auto1.de] INFO: Scrape type for JX94750: 0
2026-03-28 07:41:00 [auto1.de] INFO: Found listing with ID: HF95044
2026-03-28 07:41:00 [auto1.de] INFO: Found listing with ID: BD46064
2026-03-28 07:41:00 [auto1.de] INFO: Found listing with ID: FT81385
2026-03-28 07:41:00 [auto1.de] INFO: Found listing with ID: UG80172
2026-03-28 07:41:00 [auto1.de] INFO: Found listing with ID: MJ66272
2026-03-28 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ66272%27 HTTP/1.1" 200 None
2026-03-28 07:41:00 [auto1.de] INFO: Scrape type for MJ66272: 0
2026-03-28 07:41:00 [auto1.de] INFO: Found listing with ID: CH56246
2026-03-28 07:41:00 [auto1.de] INFO: Found listing with ID: XJ30357
2026-03-28 07:41:00 [auto1.de] INFO: Found listing with ID: HR10562
2026-03-28 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10562%27 HTTP/1.1" 200 None
2026-03-28 07:41:00 [auto1.de] INFO: Scrape type for HR10562: 0
2026-03-28 07:41:00 [auto1.de] INFO: Found listing with ID: ZW20696
2026-03-28 07:41:00 [auto1.de] INFO: Found listing with ID: AE57502
2026-03-28 07:41:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:41:06 [scrapy.extensions.logstats] INFO: Crawled 166 pages (at 25 pages/min), scraped 475 items (at 0 items/min)
2026-03-28 07:41:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 165MiB
2026-03-28 07:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:41:17 [auto1.de] INFO: Channel: 24h | Page: 161 | totalHits: 9263 | hits on page: 40
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: VW15579
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: WV70498
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: NV40301
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV40301%27 HTTP/1.1" 200 None
2026-03-28 07:41:17 [auto1.de] INFO: Scrape type for NV40301: 0
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: HY44820
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: KG96622
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG96622%27 HTTP/1.1" 200 None
2026-03-28 07:41:17 [auto1.de] INFO: Scrape type for KG96622: 0
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: KR50591
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: KH12936
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH12936%27 HTTP/1.1" 200 None
2026-03-28 07:41:17 [auto1.de] INFO: Scrape type for KH12936: 0
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: DZ36531
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ36531%27 HTTP/1.1" 200 None
2026-03-28 07:41:17 [auto1.de] INFO: Scrape type for DZ36531: 0
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: CL62984
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL62984%27 HTTP/1.1" 200 None
2026-03-28 07:41:17 [auto1.de] INFO: Scrape type for CL62984: 0
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: MG32866
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: JE47018
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: BC55238
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: NE25486
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: EU79522
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU79522%27 HTTP/1.1" 200 None
2026-03-28 07:41:17 [auto1.de] INFO: Scrape type for EU79522: 0
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: GB06112
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB06112%27 HTTP/1.1" 200 None
2026-03-28 07:41:17 [auto1.de] INFO: Scrape type for GB06112: 0
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: WE09519
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE09519%27 HTTP/1.1" 200 None
2026-03-28 07:41:17 [auto1.de] INFO: Scrape type for WE09519: 0
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: BF61357
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF61357%27 HTTP/1.1" 200 None
2026-03-28 07:41:17 [auto1.de] INFO: Scrape type for BF61357: 0
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: SZ04450
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ04450%27 HTTP/1.1" 200 None
2026-03-28 07:41:17 [auto1.de] INFO: Scrape type for SZ04450: 0
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: VE85293
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: WM19192
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM19192%27 HTTP/1.1" 200 None
2026-03-28 07:41:17 [auto1.de] INFO: Scrape type for WM19192: 0
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: ZM12960
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: KY72629
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: XX04518
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: TT07076
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT07076%27 HTTP/1.1" 200 None
2026-03-28 07:41:17 [auto1.de] INFO: Scrape type for TT07076: 0
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: UM92745
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM92745%27 HTTP/1.1" 200 None
2026-03-28 07:41:17 [auto1.de] INFO: Scrape type for UM92745: 0
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: AD35771
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD35771%27 HTTP/1.1" 200 None
2026-03-28 07:41:17 [auto1.de] INFO: Scrape type for AD35771: 0
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: PF23160
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF23160%27 HTTP/1.1" 200 None
2026-03-28 07:41:17 [auto1.de] INFO: Scrape type for PF23160: 0
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: DD75704
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD75704%27 HTTP/1.1" 200 None
2026-03-28 07:41:17 [auto1.de] INFO: Scrape type for DD75704: 0
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: BB82459
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: PR95726
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: GD94129
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: PG49368
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: MX17219
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX17219%27 HTTP/1.1" 200 None
2026-03-28 07:41:17 [auto1.de] INFO: Scrape type for MX17219: 0
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: LB24374
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB24374%27 HTTP/1.1" 200 None
2026-03-28 07:41:17 [auto1.de] INFO: Scrape type for LB24374: 0
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: JV29495
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV29495%27 HTTP/1.1" 200 None
2026-03-28 07:41:17 [auto1.de] INFO: Scrape type for JV29495: 0
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: TY10898
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY10898%27 HTTP/1.1" 200 None
2026-03-28 07:41:17 [auto1.de] INFO: Scrape type for TY10898: 0
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: FP07382
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: DE84104
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: KJ31397
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ31397%27 HTTP/1.1" 200 None
2026-03-28 07:41:17 [auto1.de] INFO: Scrape type for KJ31397: 0
2026-03-28 07:41:17 [auto1.de] INFO: Found listing with ID: FJ98191
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ98191%27 HTTP/1.1" 200 None
2026-03-28 07:41:17 [auto1.de] INFO: Scrape type for FJ98191: 0
2026-03-28 07:41:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:41:19 [auto1.de] INFO: Channel: 24h | Page: 162 | totalHits: 9264 | hits on page: 40
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: FJ98191
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ98191%27 HTTP/1.1" 200 None
2026-03-28 07:41:19 [auto1.de] INFO: Scrape type for FJ98191: 0
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: HM10464
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM10464%27 HTTP/1.1" 200 None
2026-03-28 07:41:19 [auto1.de] INFO: Scrape type for HM10464: 0
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: UY59901
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY59901%27 HTTP/1.1" 200 None
2026-03-28 07:41:19 [auto1.de] INFO: Scrape type for UY59901: 0
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: DU31630
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU31630%27 HTTP/1.1" 200 None
2026-03-28 07:41:19 [auto1.de] INFO: Scrape type for DU31630: 0
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: FU85370
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: BC52904
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: UR03591
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR03591%27 HTTP/1.1" 200 None
2026-03-28 07:41:19 [auto1.de] INFO: Scrape type for UR03591: 0
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: MJ97725
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ97725%27 HTTP/1.1" 200 None
2026-03-28 07:41:19 [auto1.de] INFO: Scrape type for MJ97725: 0
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: XE86723
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE86723%27 HTTP/1.1" 200 None
2026-03-28 07:41:19 [auto1.de] INFO: Scrape type for XE86723: 0
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: JA93486
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA93486%27 HTTP/1.1" 200 None
2026-03-28 07:41:19 [auto1.de] INFO: Scrape type for JA93486: 0
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: ST81436
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: VJ57461
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ57461%27 HTTP/1.1" 200 None
2026-03-28 07:41:19 [auto1.de] INFO: Scrape type for VJ57461: 0
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: MX03618
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: SG10067
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG10067%27 HTTP/1.1" 200 None
2026-03-28 07:41:19 [auto1.de] INFO: Scrape type for SG10067: 0
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: KV56224
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV56224%27 HTTP/1.1" 200 None
2026-03-28 07:41:19 [auto1.de] INFO: Scrape type for KV56224: 0
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: AR04951
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: NB03512
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB03512%27 HTTP/1.1" 200 None
2026-03-28 07:41:19 [auto1.de] INFO: Scrape type for NB03512: 0
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: EG87318
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG87318%27 HTTP/1.1" 200 None
2026-03-28 07:41:19 [auto1.de] INFO: Scrape type for EG87318: 0
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: YN70037
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: HA65377
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: ED74912
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: XN42361
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN42361%27 HTTP/1.1" 200 None
2026-03-28 07:41:19 [auto1.de] INFO: Scrape type for XN42361: 0
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: FX39792
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: AC95378
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: KW63428
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: CK72791
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72791%27 HTTP/1.1" 200 None
2026-03-28 07:41:19 [auto1.de] INFO: Scrape type for CK72791: 0
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: XK03693
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK03693%27 HTTP/1.1" 200 None
2026-03-28 07:41:19 [auto1.de] INFO: Scrape type for XK03693: 0
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: RV27328
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: HB28048
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: MS65923
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS65923%27 HTTP/1.1" 200 None
2026-03-28 07:41:19 [auto1.de] INFO: Scrape type for MS65923: 0
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: TA56984
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: BJ89189
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: ZN20301
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN20301%27 HTTP/1.1" 200 None
2026-03-28 07:41:19 [auto1.de] INFO: Scrape type for ZN20301: 0
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: YE63179
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE63179%27 HTTP/1.1" 200 None
2026-03-28 07:41:19 [auto1.de] INFO: Scrape type for YE63179: 0
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: YJ80540
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ80540%27 HTTP/1.1" 200 None
2026-03-28 07:41:19 [auto1.de] INFO: Scrape type for YJ80540: 0
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: HT24109
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: ZK16564
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK16564%27 HTTP/1.1" 200 None
2026-03-28 07:41:19 [auto1.de] INFO: Scrape type for ZK16564: 0
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: MD70157
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: AE54071
2026-03-28 07:41:19 [auto1.de] INFO: Found listing with ID: DS73409
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS73409%27 HTTP/1.1" 200 None
2026-03-28 07:41:19 [auto1.de] INFO: Scrape type for DS73409: 0
2026-03-28 07:41:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:41:20 [auto1.de] INFO: Channel: 24h | Page: 163 | totalHits: 9264 | hits on page: 40
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: HU57590
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU57590%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for HU57590: 0
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: BX70846
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX70846%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for BX70846: 0
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: CY07264
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY07264%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for CY07264: 0
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: TG33672
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG33672%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for TG33672: 0
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: UB25361
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: CD13721
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: JT26189
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT26189%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for JT26189: 0
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: KF39713
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF39713%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for KF39713: 0
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: HV05034
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV05034%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for HV05034: 0
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: KT12988
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: ZG14891
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14891%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for ZG14891: 0
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: VN06555
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: PC09054
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC09054%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for PC09054: 0
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: YG16236
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG16236%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for YG16236: 0
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: NL59823
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL59823%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for NL59823: 0
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: AE84214
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE84214%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for AE84214: 0
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: XY67519
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY67519%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for XY67519: 0
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: JL05117
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL05117%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for JL05117: 0
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: ZL30155
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL30155%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for ZL30155: 0
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: SL60481
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL60481%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for SL60481: 0
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: HE00518
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: AZ14861
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ14861%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for AZ14861: 0
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: KU33020
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU33020%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for KU33020: 0
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: MK34658
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: HV44481
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV44481%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for HV44481: 0
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: KS04135
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: KW12270
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW12270%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for KW12270: 0
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: XC86569
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: AZ75969
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: GR89322
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: GF09029
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: HR56257
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: BS68722
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS68722%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for BS68722: 0
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: NS17316
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: AW33862
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW33862%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for AW33862: 0
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: AN78451
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: AM68343
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: RE63795
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE63795%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for RE63795: 0
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: TH04951
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH04951%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for TH04951: 0
2026-03-28 07:41:20 [auto1.de] INFO: Found listing with ID: KA05574
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA05574%27 HTTP/1.1" 200 None
2026-03-28 07:41:20 [auto1.de] INFO: Scrape type for KA05574: 0
2026-03-28 07:41:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:41:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:41:22 [auto1.de] INFO: Channel: 24h | Page: 164 | totalHits: 9264 | hits on page: 40
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: SL45023
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: MC93517
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: PN86617
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: MF41479
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: KS86006
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS86006%27 HTTP/1.1" 200 None
2026-03-28 07:41:22 [auto1.de] INFO: Scrape type for KS86006: 0
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: DB44844
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB44844%27 HTTP/1.1" 200 None
2026-03-28 07:41:22 [auto1.de] INFO: Scrape type for DB44844: 0
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: GS08469
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS08469%27 HTTP/1.1" 200 None
2026-03-28 07:41:22 [auto1.de] INFO: Scrape type for GS08469: 0
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: VF13288
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: FK58652
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: NS53664
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS53664%27 HTTP/1.1" 200 None
2026-03-28 07:41:22 [auto1.de] INFO: Scrape type for NS53664: 0
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: JU03795
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU03795%27 HTTP/1.1" 200 None
2026-03-28 07:41:22 [auto1.de] INFO: Scrape type for JU03795: 0
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: MU77879
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU77879%27 HTTP/1.1" 200 None
2026-03-28 07:41:22 [auto1.de] INFO: Scrape type for MU77879: 0
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: TT29598
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT29598%27 HTTP/1.1" 200 None
2026-03-28 07:41:22 [auto1.de] INFO: Scrape type for TT29598: 0
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: RB44487
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: JG70236
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG70236%27 HTTP/1.1" 200 None
2026-03-28 07:41:22 [auto1.de] INFO: Scrape type for JG70236: 0
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: GD38856
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: VX50427
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: AM41961
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: WK73067
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73067%27 HTTP/1.1" 200 None
2026-03-28 07:41:22 [auto1.de] INFO: Scrape type for WK73067: 0
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: PY92753
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: KR05534
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR05534%27 HTTP/1.1" 200 None
2026-03-28 07:41:22 [auto1.de] INFO: Scrape type for KR05534: 0
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: RU43264
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: BS37801
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS37801%27 HTTP/1.1" 200 None
2026-03-28 07:41:22 [auto1.de] INFO: Scrape type for BS37801: 0
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: TF57163
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF57163%27 HTTP/1.1" 200 None
2026-03-28 07:41:22 [auto1.de] INFO: Scrape type for TF57163: 0
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: YT62931
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: HB67029
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: GS38799
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: VW61170
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: TU77981
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU77981%27 HTTP/1.1" 200 None
2026-03-28 07:41:22 [auto1.de] INFO: Scrape type for TU77981: 0
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: AC77037
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: EB91533
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB91533%27 HTTP/1.1" 200 None
2026-03-28 07:41:22 [auto1.de] INFO: Scrape type for EB91533: 0
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: UA79270
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: ZD36450
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD36450%27 HTTP/1.1" 200 None
2026-03-28 07:41:22 [auto1.de] INFO: Scrape type for ZD36450: 0
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: CK93777
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK93777%27 HTTP/1.1" 200 None
2026-03-28 07:41:22 [auto1.de] INFO: Scrape type for CK93777: 0
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: SZ50241
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: HP73171
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP73171%27 HTTP/1.1" 200 None
2026-03-28 07:41:22 [auto1.de] INFO: Scrape type for HP73171: 0
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: HW87137
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW87137%27 HTTP/1.1" 200 None
2026-03-28 07:41:22 [auto1.de] INFO: Scrape type for HW87137: 0
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: EG81564
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: HM56533
2026-03-28 07:41:22 [auto1.de] INFO: Found listing with ID: GH53408
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH53408%27 HTTP/1.1" 200 None
2026-03-28 07:41:22 [auto1.de] INFO: Scrape type for GH53408: 0
2026-03-28 07:41:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:41:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:41:23 [auto1.de] INFO: Channel: 24h | Page: 165 | totalHits: 9264 | hits on page: 40
2026-03-28 07:41:23 [auto1.de] INFO: Found listing with ID: NV91199
2026-03-28 07:41:23 [auto1.de] INFO: Found listing with ID: RR39705
2026-03-28 07:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR39705%27 HTTP/1.1" 200 None
2026-03-28 07:41:24 [auto1.de] INFO: Scrape type for RR39705: 0
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: XW64157
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: FT78842
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: NW86422
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW86422%27 HTTP/1.1" 200 None
2026-03-28 07:41:24 [auto1.de] INFO: Scrape type for NW86422: 0
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: JJ82398
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ82398%27 HTTP/1.1" 200 None
2026-03-28 07:41:24 [auto1.de] INFO: Scrape type for JJ82398: 0
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: RS29820
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS29820%27 HTTP/1.1" 200 None
2026-03-28 07:41:24 [auto1.de] INFO: Scrape type for RS29820: 0
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: VB21266
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: DE41778
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: HR99105
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: KR84974
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: RC86111
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC86111%27 HTTP/1.1" 200 None
2026-03-28 07:41:24 [auto1.de] INFO: Scrape type for RC86111: 0
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: CJ52428
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ52428%27 HTTP/1.1" 200 None
2026-03-28 07:41:24 [auto1.de] INFO: Scrape type for CJ52428: 0
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: NF13899
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF13899%27 HTTP/1.1" 200 None
2026-03-28 07:41:24 [auto1.de] INFO: Scrape type for NF13899: 0
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: MY97637
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY97637%27 HTTP/1.1" 200 None
2026-03-28 07:41:24 [auto1.de] INFO: Scrape type for MY97637: 0
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: CX13035
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: VW18097
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: AS96658
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: UW39505
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW39505%27 HTTP/1.1" 200 None
2026-03-28 07:41:24 [auto1.de] INFO: Scrape type for UW39505: 0
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: BN05463
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN05463%27 HTTP/1.1" 200 None
2026-03-28 07:41:24 [auto1.de] INFO: Scrape type for BN05463: 0
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: FJ74822
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: BM78825
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: MU28825
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: DE22331
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: ZR63828
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: NN32284
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: EZ85797
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ85797%27 HTTP/1.1" 200 None
2026-03-28 07:41:24 [auto1.de] INFO: Scrape type for EZ85797: 0
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: MT21792
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: NG90770
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: PB35717
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: WP02035
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP02035%27 HTTP/1.1" 200 None
2026-03-28 07:41:24 [auto1.de] INFO: Scrape type for WP02035: 0
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: LG96473
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG96473%27 HTTP/1.1" 200 None
2026-03-28 07:41:24 [auto1.de] INFO: Scrape type for LG96473: 0
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: EP74565
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: NM50493
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM50493%27 HTTP/1.1" 200 None
2026-03-28 07:41:24 [auto1.de] INFO: Scrape type for NM50493: 0
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: CC79816
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: KC26030
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC26030%27 HTTP/1.1" 200 None
2026-03-28 07:41:24 [auto1.de] INFO: Scrape type for KC26030: 0
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: PX71275
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX71275%27 HTTP/1.1" 200 None
2026-03-28 07:41:24 [auto1.de] INFO: Scrape type for PX71275: 0
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: NJ46216
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ46216%27 HTTP/1.1" 200 None
2026-03-28 07:41:24 [auto1.de] INFO: Scrape type for NJ46216: 0
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: GH24213
2026-03-28 07:41:24 [auto1.de] INFO: Found listing with ID: SJ57500
2026-03-28 07:41:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:41:25 [auto1.de] INFO: Channel: 24h | Page: 166 | totalHits: 9264 | hits on page: 40
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: WV66084
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV66084%27 HTTP/1.1" 200 None
2026-03-28 07:41:25 [auto1.de] INFO: Scrape type for WV66084: 0
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: CD67065
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: WD28635
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: HC51034
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC51034%27 HTTP/1.1" 200 None
2026-03-28 07:41:25 [auto1.de] INFO: Scrape type for HC51034: 0
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: YY26065
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: LD89298
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD89298%27 HTTP/1.1" 200 None
2026-03-28 07:41:25 [auto1.de] INFO: Scrape type for LD89298: 0
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: AX72910
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX72910%27 HTTP/1.1" 200 None
2026-03-28 07:41:25 [auto1.de] INFO: Scrape type for AX72910: 0
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: DE37083
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: CE15038
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: BG10671
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: ME01390
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: VY67119
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY67119%27 HTTP/1.1" 200 None
2026-03-28 07:41:25 [auto1.de] INFO: Scrape type for VY67119: 0
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: TL40939
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: YF47459
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: MC12469
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: VC37010
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC37010%27 HTTP/1.1" 200 None
2026-03-28 07:41:25 [auto1.de] INFO: Scrape type for VC37010: 0
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: GW03247
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: NG52240
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG52240%27 HTTP/1.1" 200 None
2026-03-28 07:41:25 [auto1.de] INFO: Scrape type for NG52240: 0
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: YY43681
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY43681%27 HTTP/1.1" 200 None
2026-03-28 07:41:25 [auto1.de] INFO: Scrape type for YY43681: 0
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: WG78527
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78527%27 HTTP/1.1" 200 None
2026-03-28 07:41:25 [auto1.de] INFO: Scrape type for WG78527: 0
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: WE95129
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: SB06685
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB06685%27 HTTP/1.1" 200 None
2026-03-28 07:41:25 [auto1.de] INFO: Scrape type for SB06685: 0
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: CV55682
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV55682%27 HTTP/1.1" 200 None
2026-03-28 07:41:25 [auto1.de] INFO: Scrape type for CV55682: 0
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: SY55546
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: WD35847
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: DV41071
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: BM05172
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: ZF28924
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: GD44773
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD44773%27 HTTP/1.1" 200 None
2026-03-28 07:41:25 [auto1.de] INFO: Scrape type for GD44773: 0
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: XU92987
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU92987%27 HTTP/1.1" 200 None
2026-03-28 07:41:25 [auto1.de] INFO: Scrape type for XU92987: 0
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: NJ08644
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ08644%27 HTTP/1.1" 200 None
2026-03-28 07:41:25 [auto1.de] INFO: Scrape type for NJ08644: 0
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: TE62268
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: BA43321
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: NW01824
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: VN01043
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: YK25344
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK25344%27 HTTP/1.1" 200 None
2026-03-28 07:41:25 [auto1.de] INFO: Scrape type for YK25344: 0
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: SX77194
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: EY62389
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: MT67219
2026-03-28 07:41:25 [auto1.de] INFO: Found listing with ID: HR15403
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR15403%27 HTTP/1.1" 200 None
2026-03-28 07:41:25 [auto1.de] INFO: Scrape type for HR15403: 0
2026-03-28 07:41:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:41:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:41:26 [auto1.de] INFO: Channel: 24h | Page: 167 | totalHits: 9264 | hits on page: 40
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: RA84296
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA84296%27 HTTP/1.1" 200 None
2026-03-28 07:41:26 [auto1.de] INFO: Scrape type for RA84296: 0
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: RL19832
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL19832%27 HTTP/1.1" 200 None
2026-03-28 07:41:26 [auto1.de] INFO: Scrape type for RL19832: 0
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: ZA79718
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA79718%27 HTTP/1.1" 200 None
2026-03-28 07:41:26 [auto1.de] INFO: Scrape type for ZA79718: 0
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: DZ52896
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ52896%27 HTTP/1.1" 200 None
2026-03-28 07:41:26 [auto1.de] INFO: Scrape type for DZ52896: 0
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: NN28121
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: VG06126
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: AG71347
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: MX01041
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: ZT23330
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: DY93616
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY93616%27 HTTP/1.1" 200 None
2026-03-28 07:41:26 [auto1.de] INFO: Scrape type for DY93616: 0
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: JP54184
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: TU96815
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU96815%27 HTTP/1.1" 200 None
2026-03-28 07:41:26 [auto1.de] INFO: Scrape type for TU96815: 0
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: VS51325
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: ZV51045
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV51045%27 HTTP/1.1" 200 None
2026-03-28 07:41:26 [auto1.de] INFO: Scrape type for ZV51045: 0
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: TX40216
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40216%27 HTTP/1.1" 200 None
2026-03-28 07:41:26 [auto1.de] INFO: Scrape type for TX40216: 0
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: ZY56723
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY56723%27 HTTP/1.1" 200 None
2026-03-28 07:41:26 [auto1.de] INFO: Scrape type for ZY56723: 0
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: YR11157
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: AG64287
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG64287%27 HTTP/1.1" 200 None
2026-03-28 07:41:26 [auto1.de] INFO: Scrape type for AG64287: 0
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: ZW76685
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: WM07863
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM07863%27 HTTP/1.1" 200 None
2026-03-28 07:41:26 [auto1.de] INFO: Scrape type for WM07863: 0
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: RS51050
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: DC45431
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: NS14523
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS14523%27 HTTP/1.1" 200 None
2026-03-28 07:41:26 [auto1.de] INFO: Scrape type for NS14523: 0
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: AB40080
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB40080%27 HTTP/1.1" 200 None
2026-03-28 07:41:26 [auto1.de] INFO: Scrape type for AB40080: 0
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: JX92669
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: MT04739
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT04739%27 HTTP/1.1" 200 None
2026-03-28 07:41:26 [auto1.de] INFO: Scrape type for MT04739: 0
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: XT20233
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT20233%27 HTTP/1.1" 200 None
2026-03-28 07:41:26 [auto1.de] INFO: Scrape type for XT20233: 0
2026-03-28 07:41:26 [auto1.de] INFO: Found listing with ID: BU34226
2026-03-28 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU34226%27 HTTP/1.1" 200 None
2026-03-28 07:41:27 [auto1.de] INFO: Scrape type for BU34226: 0
2026-03-28 07:41:27 [auto1.de] INFO: Found listing with ID: LM85706
2026-03-28 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM85706%27 HTTP/1.1" 200 None
2026-03-28 07:41:27 [auto1.de] INFO: Scrape type for LM85706: 0
2026-03-28 07:41:27 [auto1.de] INFO: Found listing with ID: DY76053
2026-03-28 07:41:27 [auto1.de] INFO: Found listing with ID: UU18213
2026-03-28 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU18213%27 HTTP/1.1" 200 None
2026-03-28 07:41:27 [auto1.de] INFO: Scrape type for UU18213: 0
2026-03-28 07:41:27 [auto1.de] INFO: Found listing with ID: WS03851
2026-03-28 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS03851%27 HTTP/1.1" 200 None
2026-03-28 07:41:27 [auto1.de] INFO: Scrape type for WS03851: 0
2026-03-28 07:41:27 [auto1.de] INFO: Found listing with ID: XZ00200
2026-03-28 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ00200%27 HTTP/1.1" 200 None
2026-03-28 07:41:27 [auto1.de] INFO: Scrape type for XZ00200: 0
2026-03-28 07:41:27 [auto1.de] INFO: Found listing with ID: GD72081
2026-03-28 07:41:27 [auto1.de] INFO: Found listing with ID: NN04046
2026-03-28 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN04046%27 HTTP/1.1" 200 None
2026-03-28 07:41:27 [auto1.de] INFO: Scrape type for NN04046: 0
2026-03-28 07:41:27 [auto1.de] INFO: Found listing with ID: HZ32658
2026-03-28 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ32658%27 HTTP/1.1" 200 None
2026-03-28 07:41:27 [auto1.de] INFO: Scrape type for HZ32658: 0
2026-03-28 07:41:27 [auto1.de] INFO: Found listing with ID: HP10978
2026-03-28 07:41:27 [auto1.de] INFO: Found listing with ID: FB70760
2026-03-28 07:41:27 [auto1.de] INFO: Found listing with ID: WD34588
2026-03-28 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD34588%27 HTTP/1.1" 200 None
2026-03-28 07:41:27 [auto1.de] INFO: Scrape type for WD34588: 0
2026-03-28 07:41:27 [auto1.de] INFO: Found listing with ID: BC55610
2026-03-28 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC55610%27 HTTP/1.1" 200 None
2026-03-28 07:41:27 [auto1.de] INFO: Scrape type for BC55610: 0
2026-03-28 07:41:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:41:28 [auto1.de] INFO: Channel: 24h | Page: 168 | totalHits: 9264 | hits on page: 40
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: BB09441
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: AW92079
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: UZ90391
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ90391%27 HTTP/1.1" 200 None
2026-03-28 07:41:28 [auto1.de] INFO: Scrape type for UZ90391: 0
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: VW20064
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW20064%27 HTTP/1.1" 200 None
2026-03-28 07:41:28 [auto1.de] INFO: Scrape type for VW20064: 0
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: AZ23740
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: ZL89302
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL89302%27 HTTP/1.1" 200 None
2026-03-28 07:41:28 [auto1.de] INFO: Scrape type for ZL89302: 0
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: RN79752
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN79752%27 HTTP/1.1" 200 None
2026-03-28 07:41:28 [auto1.de] INFO: Scrape type for RN79752: 0
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: TG99958
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG99958%27 HTTP/1.1" 200 None
2026-03-28 07:41:28 [auto1.de] INFO: Scrape type for TG99958: 0
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: ND34621
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND34621%27 HTTP/1.1" 200 None
2026-03-28 07:41:28 [auto1.de] INFO: Scrape type for ND34621: 0
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: WV47854
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: RK05347
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK05347%27 HTTP/1.1" 200 None
2026-03-28 07:41:28 [auto1.de] INFO: Scrape type for RK05347: 0
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: ZJ08773
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: AV69297
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: DA14400
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA14400%27 HTTP/1.1" 200 None
2026-03-28 07:41:28 [auto1.de] INFO: Scrape type for DA14400: 0
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: SV15826
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: UC15982
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: FB42809
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: VR69124
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR69124%27 HTTP/1.1" 200 None
2026-03-28 07:41:28 [auto1.de] INFO: Scrape type for VR69124: 0
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: AZ92098
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ92098%27 HTTP/1.1" 200 None
2026-03-28 07:41:28 [auto1.de] INFO: Scrape type for AZ92098: 0
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: TU42295
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU42295%27 HTTP/1.1" 200 None
2026-03-28 07:41:28 [auto1.de] INFO: Scrape type for TU42295: 0
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: TM50766
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM50766%27 HTTP/1.1" 200 None
2026-03-28 07:41:28 [auto1.de] INFO: Scrape type for TM50766: 0
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: GN70453
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: EF47074
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: EE83038
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE83038%27 HTTP/1.1" 200 None
2026-03-28 07:41:28 [auto1.de] INFO: Scrape type for EE83038: 0
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: HY62666
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: FV09122
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: YD00860
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD00860%27 HTTP/1.1" 200 None
2026-03-28 07:41:28 [auto1.de] INFO: Scrape type for YD00860: 0
2026-03-28 07:41:28 [auto1.de] INFO: Found listing with ID: UX44500
2026-03-28 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX44500%27 HTTP/1.1" 200 None
2026-03-28 07:41:29 [auto1.de] INFO: Scrape type for UX44500: 0
2026-03-28 07:41:29 [auto1.de] INFO: Found listing with ID: PG63962
2026-03-28 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG63962%27 HTTP/1.1" 200 None
2026-03-28 07:41:29 [auto1.de] INFO: Scrape type for PG63962: 0
2026-03-28 07:41:29 [auto1.de] INFO: Found listing with ID: WJ52581
2026-03-28 07:41:29 [auto1.de] INFO: Found listing with ID: MY48468
2026-03-28 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY48468%27 HTTP/1.1" 200 None
2026-03-28 07:41:29 [auto1.de] INFO: Scrape type for MY48468: 0
2026-03-28 07:41:29 [auto1.de] INFO: Found listing with ID: PY30704
2026-03-28 07:41:29 [auto1.de] INFO: Found listing with ID: PY52590
2026-03-28 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY52590%27 HTTP/1.1" 200 None
2026-03-28 07:41:29 [auto1.de] INFO: Scrape type for PY52590: 0
2026-03-28 07:41:29 [auto1.de] INFO: Found listing with ID: XR36805
2026-03-28 07:41:29 [auto1.de] INFO: Found listing with ID: AK41294
2026-03-28 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK41294%27 HTTP/1.1" 200 None
2026-03-28 07:41:29 [auto1.de] INFO: Scrape type for AK41294: 0
2026-03-28 07:41:29 [auto1.de] INFO: Found listing with ID: FJ78048
2026-03-28 07:41:29 [auto1.de] INFO: Found listing with ID: SS28030
2026-03-28 07:41:29 [auto1.de] INFO: Found listing with ID: JY30583
2026-03-28 07:41:29 [auto1.de] INFO: Found listing with ID: CS17953
2026-03-28 07:41:29 [auto1.de] INFO: Found listing with ID: PD22194
2026-03-28 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD22194%27 HTTP/1.1" 200 None
2026-03-28 07:41:29 [auto1.de] INFO: Scrape type for PD22194: 0
2026-03-28 07:41:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:41:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:41:36 [auto1.de] INFO: Channel: 24h | Page: 169 | totalHits: 9264 | hits on page: 40
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: AV62833
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV62833%27 HTTP/1.1" 200 None
2026-03-28 07:41:36 [auto1.de] INFO: Scrape type for AV62833: 0
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: VJ41763
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ41763%27 HTTP/1.1" 200 None
2026-03-28 07:41:36 [auto1.de] INFO: Scrape type for VJ41763: 0
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: NV00892
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: BJ76765
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ76765%27 HTTP/1.1" 200 None
2026-03-28 07:41:36 [auto1.de] INFO: Scrape type for BJ76765: 0
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: WY50378
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY50378%27 HTTP/1.1" 200 None
2026-03-28 07:41:36 [auto1.de] INFO: Scrape type for WY50378: 0
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: YM60092
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM60092%27 HTTP/1.1" 200 None
2026-03-28 07:41:36 [auto1.de] INFO: Scrape type for YM60092: 0
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: CZ31886
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: CL03195
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: TN12094
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: PY36433
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: AL23415
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: PB15916
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: NS82829
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS82829%27 HTTP/1.1" 200 None
2026-03-28 07:41:36 [auto1.de] INFO: Scrape type for NS82829: 0
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: BX27927
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: ZF73856
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: YX04604
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX04604%27 HTTP/1.1" 200 None
2026-03-28 07:41:36 [auto1.de] INFO: Scrape type for YX04604: 0
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: SR70263
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: WJ48379
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: CG07330
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG07330%27 HTTP/1.1" 200 None
2026-03-28 07:41:36 [auto1.de] INFO: Scrape type for CG07330: 0
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: NA05625
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: LA17342
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: CP64616
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP64616%27 HTTP/1.1" 200 None
2026-03-28 07:41:36 [auto1.de] INFO: Scrape type for CP64616: 0
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: ER30285
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: YV88881
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV88881%27 HTTP/1.1" 200 None
2026-03-28 07:41:36 [auto1.de] INFO: Scrape type for YV88881: 0
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: BS79013
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: XW21261
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW21261%27 HTTP/1.1" 200 None
2026-03-28 07:41:36 [auto1.de] INFO: Scrape type for XW21261: 0
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: GA77532
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA77532%27 HTTP/1.1" 200 None
2026-03-28 07:41:36 [auto1.de] INFO: Scrape type for GA77532: 0
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: MK35059
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK35059%27 HTTP/1.1" 200 None
2026-03-28 07:41:36 [auto1.de] INFO: Scrape type for MK35059: 0
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: RN83637
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: VX93609
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: XV47877
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: GM35887
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM35887%27 HTTP/1.1" 200 None
2026-03-28 07:41:36 [auto1.de] INFO: Scrape type for GM35887: 0
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: WY51014
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: CY67531
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY67531%27 HTTP/1.1" 200 None
2026-03-28 07:41:36 [auto1.de] INFO: Scrape type for CY67531: 0
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: SC90935
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: RP15707
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: EF86082
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF86082%27 HTTP/1.1" 200 None
2026-03-28 07:41:36 [auto1.de] INFO: Scrape type for EF86082: 0
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: JM14062
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: GS86907
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS86907%27 HTTP/1.1" 200 None
2026-03-28 07:41:36 [auto1.de] INFO: Scrape type for GS86907: 0
2026-03-28 07:41:36 [auto1.de] INFO: Found listing with ID: YC00325
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00325%27 HTTP/1.1" 200 None
2026-03-28 07:41:36 [auto1.de] INFO: Scrape type for YC00325: 0
2026-03-28 07:41:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:41:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:41:38 [auto1.de] INFO: Channel: 24h | Page: 170 | totalHits: 9264 | hits on page: 40
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: WP84657
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: DX83058
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: FP14792
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: UG59761
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG59761%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for UG59761: 0
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: ZT71502
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT71502%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for ZT71502: 0
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: ZA30968
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: RZ98922
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: RK12906
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK12906%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for RK12906: 0
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: RG49246
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: ED07597
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED07597%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for ED07597: 0
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: UJ63993
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ63993%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for UJ63993: 0
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: TR63216
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: FA61594
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: TB30393
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: YF72599
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF72599%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for YF72599: 0
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: JS20731
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS20731%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for JS20731: 0
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: CV29491
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV29491%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for CV29491: 0
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: SP08055
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP08055%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for SP08055: 0
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: YM37957
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM37957%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for YM37957: 0
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: VG55778
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG55778%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for VG55778: 0
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: KP94641
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP94641%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for KP94641: 0
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: KM78395
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM78395%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for KM78395: 0
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: CV00012
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV00012%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for CV00012: 0
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: WT94690
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT94690%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for WT94690: 0
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: FC75041
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC75041%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for FC75041: 0
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: FU20206
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU20206%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for FU20206: 0
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: CT73600
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT73600%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for CT73600: 0
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: VX80361
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: NZ97529
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: HV65540
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: GP15297
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP15297%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for GP15297: 0
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: VF52184
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF52184%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for VF52184: 0
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: PS45422
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS45422%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for PS45422: 0
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: UP11609
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP11609%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for UP11609: 0
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: UY98084
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY98084%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for UY98084: 0
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: KZ61703
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: LT58589
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: LD03873
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD03873%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for LD03873: 0
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: ZM99082
2026-03-28 07:41:38 [auto1.de] INFO: Found listing with ID: MP71410
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP71410%27 HTTP/1.1" 200 None
2026-03-28 07:41:38 [auto1.de] INFO: Scrape type for MP71410: 0
2026-03-28 07:41:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:41:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:41:40 [auto1.de] INFO: Channel: 24h | Page: 171 | totalHits: 9264 | hits on page: 40
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: YU69669
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU69669%27 HTTP/1.1" 200 None
2026-03-28 07:41:40 [auto1.de] INFO: Scrape type for YU69669: 0
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: ZX93034
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: ZT51756
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT51756%27 HTTP/1.1" 200 None
2026-03-28 07:41:40 [auto1.de] INFO: Scrape type for ZT51756: 0
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: RS77004
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS77004%27 HTTP/1.1" 200 None
2026-03-28 07:41:40 [auto1.de] INFO: Scrape type for RS77004: 0
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: ML30380
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: ER89217
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER89217%27 HTTP/1.1" 200 None
2026-03-28 07:41:40 [auto1.de] INFO: Scrape type for ER89217: 0
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: YH59538
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: NP05566
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP05566%27 HTTP/1.1" 200 None
2026-03-28 07:41:40 [auto1.de] INFO: Scrape type for NP05566: 0
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: UZ52700
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ52700%27 HTTP/1.1" 200 None
2026-03-28 07:41:40 [auto1.de] INFO: Scrape type for UZ52700: 0
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: NP37775
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: ZC13523
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC13523%27 HTTP/1.1" 200 None
2026-03-28 07:41:40 [auto1.de] INFO: Scrape type for ZC13523: 0
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: ZD82611
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: VE54720
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE54720%27 HTTP/1.1" 200 None
2026-03-28 07:41:40 [auto1.de] INFO: Scrape type for VE54720: 0
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: KE50897
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: FV67492
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: DL77544
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: BE55257
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE55257%27 HTTP/1.1" 200 None
2026-03-28 07:41:40 [auto1.de] INFO: Scrape type for BE55257: 0
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: TS05974
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: VD13122
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: ME79930
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME79930%27 HTTP/1.1" 200 None
2026-03-28 07:41:40 [auto1.de] INFO: Scrape type for ME79930: 0
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: FA63852
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: FK15614
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: XG45401
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: ZD80559
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD80559%27 HTTP/1.1" 200 None
2026-03-28 07:41:40 [auto1.de] INFO: Scrape type for ZD80559: 0
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: EJ14046
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ14046%27 HTTP/1.1" 200 None
2026-03-28 07:41:40 [auto1.de] INFO: Scrape type for EJ14046: 0
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: KK98414
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: VU97666
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: SM38981
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: PV53792
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: BS22515
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS22515%27 HTTP/1.1" 200 None
2026-03-28 07:41:40 [auto1.de] INFO: Scrape type for BS22515: 0
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: TV91582
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: TX61544
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX61544%27 HTTP/1.1" 200 None
2026-03-28 07:41:40 [auto1.de] INFO: Scrape type for TX61544: 0
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: EB16360
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB16360%27 HTTP/1.1" 200 None
2026-03-28 07:41:40 [auto1.de] INFO: Scrape type for EB16360: 0
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: MP20467
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: RV91936
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV91936%27 HTTP/1.1" 200 None
2026-03-28 07:41:40 [auto1.de] INFO: Scrape type for RV91936: 0
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: UJ17280
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ17280%27 HTTP/1.1" 200 None
2026-03-28 07:41:40 [auto1.de] INFO: Scrape type for UJ17280: 0
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: YY97428
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: JB06991
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: CT74985
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT74985%27 HTTP/1.1" 200 None
2026-03-28 07:41:40 [auto1.de] INFO: Scrape type for CT74985: 0
2026-03-28 07:41:40 [auto1.de] INFO: Found listing with ID: NN29635
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN29635%27 HTTP/1.1" 200 None
2026-03-28 07:41:40 [auto1.de] INFO: Scrape type for NN29635: 0
2026-03-28 07:41:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:41:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:41:41 [auto1.de] INFO: Channel: 24h | Page: 172 | totalHits: 9264 | hits on page: 40
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: SU34642
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: VP61348
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: RT05555
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: CZ58938
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ58938%27 HTTP/1.1" 200 None
2026-03-28 07:41:41 [auto1.de] INFO: Scrape type for CZ58938: 0
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: GZ05428
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ05428%27 HTTP/1.1" 200 None
2026-03-28 07:41:41 [auto1.de] INFO: Scrape type for GZ05428: 0
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: JF69032
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF69032%27 HTTP/1.1" 200 None
2026-03-28 07:41:41 [auto1.de] INFO: Scrape type for JF69032: 0
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: WL72774
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: KM72305
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: EN65963
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: NZ89642
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: MD93182
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: MU35402
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU35402%27 HTTP/1.1" 200 None
2026-03-28 07:41:41 [auto1.de] INFO: Scrape type for MU35402: 0
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: CJ40917
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: JA99726
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA99726%27 HTTP/1.1" 200 None
2026-03-28 07:41:41 [auto1.de] INFO: Scrape type for JA99726: 0
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: LJ53831
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ53831%27 HTTP/1.1" 200 None
2026-03-28 07:41:41 [auto1.de] INFO: Scrape type for LJ53831: 0
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: GJ23792
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ23792%27 HTTP/1.1" 200 None
2026-03-28 07:41:41 [auto1.de] INFO: Scrape type for GJ23792: 0
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: BU16541
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU16541%27 HTTP/1.1" 200 None
2026-03-28 07:41:41 [auto1.de] INFO: Scrape type for BU16541: 0
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: SJ81609
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: WJ23528
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ23528%27 HTTP/1.1" 200 None
2026-03-28 07:41:41 [auto1.de] INFO: Scrape type for WJ23528: 0
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: CU90865
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: XE45895
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE45895%27 HTTP/1.1" 200 None
2026-03-28 07:41:41 [auto1.de] INFO: Scrape type for XE45895: 0
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: SG56142
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG56142%27 HTTP/1.1" 200 None
2026-03-28 07:41:41 [auto1.de] INFO: Scrape type for SG56142: 0
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: TX03008
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX03008%27 HTTP/1.1" 200 None
2026-03-28 07:41:41 [auto1.de] INFO: Scrape type for TX03008: 0
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: BN88120
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN88120%27 HTTP/1.1" 200 None
2026-03-28 07:41:41 [auto1.de] INFO: Scrape type for BN88120: 0
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: YT80911
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT80911%27 HTTP/1.1" 200 None
2026-03-28 07:41:41 [auto1.de] INFO: Scrape type for YT80911: 0
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: KF63031
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF63031%27 HTTP/1.1" 200 None
2026-03-28 07:41:41 [auto1.de] INFO: Scrape type for KF63031: 0
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: RP62848
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP62848%27 HTTP/1.1" 200 None
2026-03-28 07:41:41 [auto1.de] INFO: Scrape type for RP62848: 0
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: HZ18082
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: RP08748
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP08748%27 HTTP/1.1" 200 None
2026-03-28 07:41:41 [auto1.de] INFO: Scrape type for RP08748: 0
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: BB54670
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB54670%27 HTTP/1.1" 200 None
2026-03-28 07:41:41 [auto1.de] INFO: Scrape type for BB54670: 0
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: BZ79041
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: JJ98035
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: MA53170
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: EH58090
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: ER42295
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER42295%27 HTTP/1.1" 200 None
2026-03-28 07:41:41 [auto1.de] INFO: Scrape type for ER42295: 0
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: UL81757
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL81757%27 HTTP/1.1" 200 None
2026-03-28 07:41:41 [auto1.de] INFO: Scrape type for UL81757: 0
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: MX99530
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: YA08526
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08526%27 HTTP/1.1" 200 None
2026-03-28 07:41:41 [auto1.de] INFO: Scrape type for YA08526: 0
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: YS01662
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS01662%27 HTTP/1.1" 200 None
2026-03-28 07:41:41 [auto1.de] INFO: Scrape type for YS01662: 0
2026-03-28 07:41:41 [auto1.de] INFO: Found listing with ID: LN28697
2026-03-28 07:41:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:41:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:41:43 [auto1.de] INFO: Channel: 24h | Page: 173 | totalHits: 9264 | hits on page: 40
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: TB72166
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: SE25361
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE25361%27 HTTP/1.1" 200 None
2026-03-28 07:41:43 [auto1.de] INFO: Scrape type for SE25361: 0
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: DB36710
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: JY30766
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: RL83292
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL83292%27 HTTP/1.1" 200 None
2026-03-28 07:41:43 [auto1.de] INFO: Scrape type for RL83292: 0
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: YW15548
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW15548%27 HTTP/1.1" 200 None
2026-03-28 07:41:43 [auto1.de] INFO: Scrape type for YW15548: 0
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: RF64064
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: HF48601
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF48601%27 HTTP/1.1" 200 None
2026-03-28 07:41:43 [auto1.de] INFO: Scrape type for HF48601: 0
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: EY31921
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY31921%27 HTTP/1.1" 200 None
2026-03-28 07:41:43 [auto1.de] INFO: Scrape type for EY31921: 0
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: GG87690
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: LS72141
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS72141%27 HTTP/1.1" 200 None
2026-03-28 07:41:43 [auto1.de] INFO: Scrape type for LS72141: 0
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: FA75858
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA75858%27 HTTP/1.1" 200 None
2026-03-28 07:41:43 [auto1.de] INFO: Scrape type for FA75858: 0
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: BU40538
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: WN52333
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: PA40823
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: AA44397
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: YZ86105
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ86105%27 HTTP/1.1" 200 None
2026-03-28 07:41:43 [auto1.de] INFO: Scrape type for YZ86105: 0
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: CD09262
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD09262%27 HTTP/1.1" 200 None
2026-03-28 07:41:43 [auto1.de] INFO: Scrape type for CD09262: 0
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: KA82816
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: BU81814
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU81814%27 HTTP/1.1" 200 None
2026-03-28 07:41:43 [auto1.de] INFO: Scrape type for BU81814: 0
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: HU51237
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: PC78051
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: YC54043
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: UC35648
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: AE68185
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: GC63268
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC63268%27 HTTP/1.1" 200 None
2026-03-28 07:41:43 [auto1.de] INFO: Scrape type for GC63268: 0
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: XJ41164
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ41164%27 HTTP/1.1" 200 None
2026-03-28 07:41:43 [auto1.de] INFO: Scrape type for XJ41164: 0
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: EM52017
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: EV46611
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: XA88514
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA88514%27 HTTP/1.1" 200 None
2026-03-28 07:41:43 [auto1.de] INFO: Scrape type for XA88514: 0
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: MS39817
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: CH25051
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH25051%27 HTTP/1.1" 200 None
2026-03-28 07:41:43 [auto1.de] INFO: Scrape type for CH25051: 0
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: CG28709
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG28709%27 HTTP/1.1" 200 None
2026-03-28 07:41:43 [auto1.de] INFO: Scrape type for CG28709: 0
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: JZ68133
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ68133%27 HTTP/1.1" 200 None
2026-03-28 07:41:43 [auto1.de] INFO: Scrape type for JZ68133: 0
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: AY81223
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY81223%27 HTTP/1.1" 200 None
2026-03-28 07:41:43 [auto1.de] INFO: Scrape type for AY81223: 0
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: WR45011
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR45011%27 HTTP/1.1" 200 None
2026-03-28 07:41:43 [auto1.de] INFO: Scrape type for WR45011: 0
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: US51436
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US51436%27 HTTP/1.1" 200 None
2026-03-28 07:41:43 [auto1.de] INFO: Scrape type for US51436: 0
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: RN25126
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: TA92521
2026-03-28 07:41:43 [auto1.de] INFO: Found listing with ID: EY70159
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY70159%27 HTTP/1.1" 200 None
2026-03-28 07:41:43 [auto1.de] INFO: Scrape type for EY70159: 0
2026-03-28 07:41:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:41:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:41:44 [auto1.de] INFO: Channel: 24h | Page: 174 | totalHits: 9264 | hits on page: 40
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: UD22753
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD22753%27 HTTP/1.1" 200 None
2026-03-28 07:41:44 [auto1.de] INFO: Scrape type for UD22753: 0
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: UE75515
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE75515%27 HTTP/1.1" 200 None
2026-03-28 07:41:44 [auto1.de] INFO: Scrape type for UE75515: 0
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: RN12872
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN12872%27 HTTP/1.1" 200 None
2026-03-28 07:41:44 [auto1.de] INFO: Scrape type for RN12872: 0
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: NT80809
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: JF36424
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: UJ83217
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ83217%27 HTTP/1.1" 200 None
2026-03-28 07:41:44 [auto1.de] INFO: Scrape type for UJ83217: 0
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: YF40819
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF40819%27 HTTP/1.1" 200 None
2026-03-28 07:41:44 [auto1.de] INFO: Scrape type for YF40819: 0
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: RV42869
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: CD08059
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: UD17125
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: BB73401
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB73401%27 HTTP/1.1" 200 None
2026-03-28 07:41:44 [auto1.de] INFO: Scrape type for BB73401: 0
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: LD62620
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: LK83365
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK83365%27 HTTP/1.1" 200 None
2026-03-28 07:41:44 [auto1.de] INFO: Scrape type for LK83365: 0
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: US02257
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: FX67630
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: SX08499
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX08499%27 HTTP/1.1" 200 None
2026-03-28 07:41:44 [auto1.de] INFO: Scrape type for SX08499: 0
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: FL51955
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL51955%27 HTTP/1.1" 200 None
2026-03-28 07:41:44 [auto1.de] INFO: Scrape type for FL51955: 0
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: HR62368
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR62368%27 HTTP/1.1" 200 None
2026-03-28 07:41:44 [auto1.de] INFO: Scrape type for HR62368: 0
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: AB72988
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB72988%27 HTTP/1.1" 200 None
2026-03-28 07:41:44 [auto1.de] INFO: Scrape type for AB72988: 0
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: XJ90591
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: FR11509
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: CS04042
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: PE84798
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: SZ45065
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ45065%27 HTTP/1.1" 200 None
2026-03-28 07:41:44 [auto1.de] INFO: Scrape type for SZ45065: 0
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: FH59067
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: DS16746
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: RY43814
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY43814%27 HTTP/1.1" 200 None
2026-03-28 07:41:44 [auto1.de] INFO: Scrape type for RY43814: 0
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: ER23285
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER23285%27 HTTP/1.1" 200 None
2026-03-28 07:41:44 [auto1.de] INFO: Scrape type for ER23285: 0
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: XF17671
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: MU36572
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU36572%27 HTTP/1.1" 200 None
2026-03-28 07:41:44 [auto1.de] INFO: Scrape type for MU36572: 0
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: NA61105
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA61105%27 HTTP/1.1" 200 None
2026-03-28 07:41:44 [auto1.de] INFO: Scrape type for NA61105: 0
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: WM57318
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM57318%27 HTTP/1.1" 200 None
2026-03-28 07:41:44 [auto1.de] INFO: Scrape type for WM57318: 0
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: CJ16536
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ16536%27 HTTP/1.1" 200 None
2026-03-28 07:41:44 [auto1.de] INFO: Scrape type for CJ16536: 0
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: EX84018
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX84018%27 HTTP/1.1" 200 None
2026-03-28 07:41:44 [auto1.de] INFO: Scrape type for EX84018: 0
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: FW84422
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: MX67239
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX67239%27 HTTP/1.1" 200 None
2026-03-28 07:41:44 [auto1.de] INFO: Scrape type for MX67239: 0
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: AM76407
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: XR91127
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR91127%27 HTTP/1.1" 200 None
2026-03-28 07:41:44 [auto1.de] INFO: Scrape type for XR91127: 0
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: HR89143
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR89143%27 HTTP/1.1" 200 None
2026-03-28 07:41:44 [auto1.de] INFO: Scrape type for HR89143: 0
2026-03-28 07:41:44 [auto1.de] INFO: Found listing with ID: RH02243
2026-03-28 07:41:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:41:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:41:46 [auto1.de] INFO: Channel: 24h | Page: 175 | totalHits: 9264 | hits on page: 40
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: PJ50890
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: AL22158
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL22158%27 HTTP/1.1" 200 None
2026-03-28 07:41:46 [auto1.de] INFO: Scrape type for AL22158: 0
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: WK68156
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: FW15775
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: YY67246
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY67246%27 HTTP/1.1" 200 None
2026-03-28 07:41:46 [auto1.de] INFO: Scrape type for YY67246: 0
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: RM23787
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: XE05980
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE05980%27 HTTP/1.1" 200 None
2026-03-28 07:41:46 [auto1.de] INFO: Scrape type for XE05980: 0
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: AY55181
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: UX52309
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX52309%27 HTTP/1.1" 200 None
2026-03-28 07:41:46 [auto1.de] INFO: Scrape type for UX52309: 0
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: TZ00942
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ00942%27 HTTP/1.1" 200 None
2026-03-28 07:41:46 [auto1.de] INFO: Scrape type for TZ00942: 0
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: XS48010
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS48010%27 HTTP/1.1" 200 None
2026-03-28 07:41:46 [auto1.de] INFO: Scrape type for XS48010: 0
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: NP91596
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: VB58565
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: AK86210
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: GZ90473
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: YG40047
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG40047%27 HTTP/1.1" 200 None
2026-03-28 07:41:46 [auto1.de] INFO: Scrape type for YG40047: 0
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: JA36918
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA36918%27 HTTP/1.1" 200 None
2026-03-28 07:41:46 [auto1.de] INFO: Scrape type for JA36918: 0
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: UD76012
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD76012%27 HTTP/1.1" 200 None
2026-03-28 07:41:46 [auto1.de] INFO: Scrape type for UD76012: 0
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: CE30304
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: PD48755
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: DF55322
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF55322%27 HTTP/1.1" 200 None
2026-03-28 07:41:46 [auto1.de] INFO: Scrape type for DF55322: 0
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: NG28413
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: HG25993
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: AV07522
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: LT01619
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT01619%27 HTTP/1.1" 200 None
2026-03-28 07:41:46 [auto1.de] INFO: Scrape type for LT01619: 0
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: FV18875
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV18875%27 HTTP/1.1" 200 None
2026-03-28 07:41:46 [auto1.de] INFO: Scrape type for FV18875: 0
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: VE41795
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41795%27 HTTP/1.1" 200 None
2026-03-28 07:41:46 [auto1.de] INFO: Scrape type for VE41795: 0
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: BJ39418
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: XK79004
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK79004%27 HTTP/1.1" 200 None
2026-03-28 07:41:46 [auto1.de] INFO: Scrape type for XK79004: 0
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: BM71162
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: KC92334
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: GB85775
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB85775%27 HTTP/1.1" 200 None
2026-03-28 07:41:46 [auto1.de] INFO: Scrape type for GB85775: 0
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: ZR44160
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: WM90118
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM90118%27 HTTP/1.1" 200 None
2026-03-28 07:41:46 [auto1.de] INFO: Scrape type for WM90118: 0
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: RB15506
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB15506%27 HTTP/1.1" 200 None
2026-03-28 07:41:46 [auto1.de] INFO: Scrape type for RB15506: 0
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: ZR64045
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: TZ06235
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ06235%27 HTTP/1.1" 200 None
2026-03-28 07:41:46 [auto1.de] INFO: Scrape type for TZ06235: 0
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: GC28656
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC28656%27 HTTP/1.1" 200 None
2026-03-28 07:41:46 [auto1.de] INFO: Scrape type for GC28656: 0
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: WS17164
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS17164%27 HTTP/1.1" 200 None
2026-03-28 07:41:46 [auto1.de] INFO: Scrape type for WS17164: 0
2026-03-28 07:41:46 [auto1.de] INFO: Found listing with ID: FG07323
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG07323%27 HTTP/1.1" 200 None
2026-03-28 07:41:46 [auto1.de] INFO: Scrape type for FG07323: 0
2026-03-28 07:41:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:41:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:41:47 [auto1.de] INFO: Channel: 24h | Page: 176 | totalHits: 9264 | hits on page: 40
2026-03-28 07:41:47 [auto1.de] INFO: Found listing with ID: SE90361
2026-03-28 07:41:47 [auto1.de] INFO: Found listing with ID: EU47039
2026-03-28 07:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU47039%27 HTTP/1.1" 200 None
2026-03-28 07:41:47 [auto1.de] INFO: Scrape type for EU47039: 0
2026-03-28 07:41:47 [auto1.de] INFO: Found listing with ID: VM51620
2026-03-28 07:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM51620%27 HTTP/1.1" 200 None
2026-03-28 07:41:47 [auto1.de] INFO: Scrape type for VM51620: 0
2026-03-28 07:41:47 [auto1.de] INFO: Found listing with ID: UL30875
2026-03-28 07:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL30875%27 HTTP/1.1" 200 None
2026-03-28 07:41:47 [auto1.de] INFO: Scrape type for UL30875: 0
2026-03-28 07:41:47 [auto1.de] INFO: Found listing with ID: CM43625
2026-03-28 07:41:47 [auto1.de] INFO: Found listing with ID: ZC04825
2026-03-28 07:41:47 [auto1.de] INFO: Found listing with ID: LG87332
2026-03-28 07:41:47 [auto1.de] INFO: Found listing with ID: VR75394
2026-03-28 07:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR75394%27 HTTP/1.1" 200 None
2026-03-28 07:41:47 [auto1.de] INFO: Scrape type for VR75394: 0
2026-03-28 07:41:47 [auto1.de] INFO: Found listing with ID: PY18559
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: MN13665
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN13665%27 HTTP/1.1" 200 None
2026-03-28 07:41:48 [auto1.de] INFO: Scrape type for MN13665: 0
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: UJ44809
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: ZC16188
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: SK97361
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: DD55513
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD55513%27 HTTP/1.1" 200 None
2026-03-28 07:41:48 [auto1.de] INFO: Scrape type for DD55513: 0
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: JX37368
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: TT34866
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT34866%27 HTTP/1.1" 200 None
2026-03-28 07:41:48 [auto1.de] INFO: Scrape type for TT34866: 0
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: HS97116
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: MW11829
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW11829%27 HTTP/1.1" 200 None
2026-03-28 07:41:48 [auto1.de] INFO: Scrape type for MW11829: 0
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: SZ87491
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ87491%27 HTTP/1.1" 200 None
2026-03-28 07:41:48 [auto1.de] INFO: Scrape type for SZ87491: 0
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: HN55751
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN55751%27 HTTP/1.1" 200 None
2026-03-28 07:41:48 [auto1.de] INFO: Scrape type for HN55751: 0
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: VY03646
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: WY86449
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: WL89525
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL89525%27 HTTP/1.1" 200 None
2026-03-28 07:41:48 [auto1.de] INFO: Scrape type for WL89525: 0
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: WY09596
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY09596%27 HTTP/1.1" 200 None
2026-03-28 07:41:48 [auto1.de] INFO: Scrape type for WY09596: 0
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: XS52651
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: XB74234
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB74234%27 HTTP/1.1" 200 None
2026-03-28 07:41:48 [auto1.de] INFO: Scrape type for XB74234: 0
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: SZ51903
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: FL69651
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: ZX86337
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX86337%27 HTTP/1.1" 200 None
2026-03-28 07:41:48 [auto1.de] INFO: Scrape type for ZX86337: 0
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: FP03650
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP03650%27 HTTP/1.1" 200 None
2026-03-28 07:41:48 [auto1.de] INFO: Scrape type for FP03650: 0
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: FU12915
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU12915%27 HTTP/1.1" 200 None
2026-03-28 07:41:48 [auto1.de] INFO: Scrape type for FU12915: 0
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: VG72840
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG72840%27 HTTP/1.1" 200 None
2026-03-28 07:41:48 [auto1.de] INFO: Scrape type for VG72840: 0
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: GT92909
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT92909%27 HTTP/1.1" 200 None
2026-03-28 07:41:48 [auto1.de] INFO: Scrape type for GT92909: 0
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: DH72575
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH72575%27 HTTP/1.1" 200 None
2026-03-28 07:41:48 [auto1.de] INFO: Scrape type for DH72575: 0
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: BX05285
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX05285%27 HTTP/1.1" 200 None
2026-03-28 07:41:48 [auto1.de] INFO: Scrape type for BX05285: 0
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: HU37680
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: LA11075
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA11075%27 HTTP/1.1" 200 None
2026-03-28 07:41:48 [auto1.de] INFO: Scrape type for LA11075: 0
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: CE80644
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE80644%27 HTTP/1.1" 200 None
2026-03-28 07:41:48 [auto1.de] INFO: Scrape type for CE80644: 0
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: YG74367
2026-03-28 07:41:48 [auto1.de] INFO: Found listing with ID: HG24809
2026-03-28 07:41:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:41:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:41:49 [auto1.de] INFO: Channel: 24h | Page: 177 | totalHits: 9264 | hits on page: 40
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: LF60633
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF60633%27 HTTP/1.1" 200 None
2026-03-28 07:41:49 [auto1.de] INFO: Scrape type for LF60633: 0
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: GE56014
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: VZ02444
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ02444%27 HTTP/1.1" 200 None
2026-03-28 07:41:49 [auto1.de] INFO: Scrape type for VZ02444: 0
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: FH65509
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH65509%27 HTTP/1.1" 200 None
2026-03-28 07:41:49 [auto1.de] INFO: Scrape type for FH65509: 0
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: CU18716
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: WJ85082
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: TF47894
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: MX28919
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: AP92874
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP92874%27 HTTP/1.1" 200 None
2026-03-28 07:41:49 [auto1.de] INFO: Scrape type for AP92874: 0
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: XF17082
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: VZ57974
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ57974%27 HTTP/1.1" 200 None
2026-03-28 07:41:49 [auto1.de] INFO: Scrape type for VZ57974: 0
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: CU58211
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU58211%27 HTTP/1.1" 200 None
2026-03-28 07:41:49 [auto1.de] INFO: Scrape type for CU58211: 0
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: CT99178
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: ZK53162
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: BU19474
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: FX76120
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX76120%27 HTTP/1.1" 200 None
2026-03-28 07:41:49 [auto1.de] INFO: Scrape type for FX76120: 0
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: LX20834
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX20834%27 HTTP/1.1" 200 None
2026-03-28 07:41:49 [auto1.de] INFO: Scrape type for LX20834: 0
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: EE70879
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE70879%27 HTTP/1.1" 200 None
2026-03-28 07:41:49 [auto1.de] INFO: Scrape type for EE70879: 0
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: RS53381
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS53381%27 HTTP/1.1" 200 None
2026-03-28 07:41:49 [auto1.de] INFO: Scrape type for RS53381: 0
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: FR48233
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR48233%27 HTTP/1.1" 200 None
2026-03-28 07:41:49 [auto1.de] INFO: Scrape type for FR48233: 0
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: VC03178
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC03178%27 HTTP/1.1" 200 None
2026-03-28 07:41:49 [auto1.de] INFO: Scrape type for VC03178: 0
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: AT04961
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: DP93170
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP93170%27 HTTP/1.1" 200 None
2026-03-28 07:41:49 [auto1.de] INFO: Scrape type for DP93170: 0
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: MK25304
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: VL67140
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: PV23410
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV23410%27 HTTP/1.1" 200 None
2026-03-28 07:41:49 [auto1.de] INFO: Scrape type for PV23410: 0
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: WN67073
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN67073%27 HTTP/1.1" 200 None
2026-03-28 07:41:49 [auto1.de] INFO: Scrape type for WN67073: 0
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: YT49063
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT49063%27 HTTP/1.1" 200 None
2026-03-28 07:41:49 [auto1.de] INFO: Scrape type for YT49063: 0
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: XR18256
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR18256%27 HTTP/1.1" 200 None
2026-03-28 07:41:49 [auto1.de] INFO: Scrape type for XR18256: 0
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: FE23921
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE23921%27 HTTP/1.1" 200 None
2026-03-28 07:41:49 [auto1.de] INFO: Scrape type for FE23921: 0
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: LK21356
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK21356%27 HTTP/1.1" 200 None
2026-03-28 07:41:49 [auto1.de] INFO: Scrape type for LK21356: 0
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: RR91619
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR91619%27 HTTP/1.1" 200 None
2026-03-28 07:41:49 [auto1.de] INFO: Scrape type for RR91619: 0
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: HM21196
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: XB85812
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: AK64805
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: TR96368
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR96368%27 HTTP/1.1" 200 None
2026-03-28 07:41:49 [auto1.de] INFO: Scrape type for TR96368: 0
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: NK67778
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK67778%27 HTTP/1.1" 200 None
2026-03-28 07:41:49 [auto1.de] INFO: Scrape type for NK67778: 0
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: TV50499
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV50499%27 HTTP/1.1" 200 None
2026-03-28 07:41:49 [auto1.de] INFO: Scrape type for TV50499: 0
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: RT04341
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT04341%27 HTTP/1.1" 200 None
2026-03-28 07:41:49 [auto1.de] INFO: Scrape type for RT04341: 0
2026-03-28 07:41:49 [auto1.de] INFO: Found listing with ID: LK78383
2026-03-28 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK78383%27 HTTP/1.1" 200 None
2026-03-28 07:41:50 [auto1.de] INFO: Scrape type for LK78383: 0
2026-03-28 07:41:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:41:51 [auto1.de] INFO: Channel: 24h | Page: 178 | totalHits: 9264 | hits on page: 40
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: RH95863
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH95863%27 HTTP/1.1" 200 None
2026-03-28 07:41:51 [auto1.de] INFO: Scrape type for RH95863: 0
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: DT99526
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: TL32343
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL32343%27 HTTP/1.1" 200 None
2026-03-28 07:41:51 [auto1.de] INFO: Scrape type for TL32343: 0
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: NK05730
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK05730%27 HTTP/1.1" 200 None
2026-03-28 07:41:51 [auto1.de] INFO: Scrape type for NK05730: 0
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: NY96837
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY96837%27 HTTP/1.1" 200 None
2026-03-28 07:41:51 [auto1.de] INFO: Scrape type for NY96837: 0
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: EY55649
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY55649%27 HTTP/1.1" 200 None
2026-03-28 07:41:51 [auto1.de] INFO: Scrape type for EY55649: 0
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: CW06535
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW06535%27 HTTP/1.1" 200 None
2026-03-28 07:41:51 [auto1.de] INFO: Scrape type for CW06535: 0
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: SZ37158
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ37158%27 HTTP/1.1" 200 None
2026-03-28 07:41:51 [auto1.de] INFO: Scrape type for SZ37158: 0
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: ZE95100
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: XK27021
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: WX50182
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX50182%27 HTTP/1.1" 200 None
2026-03-28 07:41:51 [auto1.de] INFO: Scrape type for WX50182: 0
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: NK77096
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK77096%27 HTTP/1.1" 200 None
2026-03-28 07:41:51 [auto1.de] INFO: Scrape type for NK77096: 0
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: JL68232
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL68232%27 HTTP/1.1" 200 None
2026-03-28 07:41:51 [auto1.de] INFO: Scrape type for JL68232: 0
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: WN51160
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: ED55965
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED55965%27 HTTP/1.1" 200 None
2026-03-28 07:41:51 [auto1.de] INFO: Scrape type for ED55965: 0
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: EB27045
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB27045%27 HTTP/1.1" 200 None
2026-03-28 07:41:51 [auto1.de] INFO: Scrape type for EB27045: 0
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: MB48491
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB48491%27 HTTP/1.1" 200 None
2026-03-28 07:41:51 [auto1.de] INFO: Scrape type for MB48491: 0
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: JR79236
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: XH89248
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH89248%27 HTTP/1.1" 200 None
2026-03-28 07:41:51 [auto1.de] INFO: Scrape type for XH89248: 0
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: WX91762
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX91762%27 HTTP/1.1" 200 None
2026-03-28 07:41:51 [auto1.de] INFO: Scrape type for WX91762: 0
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: VZ25719
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: XM39698
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM39698%27 HTTP/1.1" 200 None
2026-03-28 07:41:51 [auto1.de] INFO: Scrape type for XM39698: 0
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: YP47874
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: AU99982
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: HY60596
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: AY94594
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: CM78199
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: CG01662
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: NU38157
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU38157%27 HTTP/1.1" 200 None
2026-03-28 07:41:51 [auto1.de] INFO: Scrape type for NU38157: 0
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: XE06638
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: XC20184
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC20184%27 HTTP/1.1" 200 None
2026-03-28 07:41:51 [auto1.de] INFO: Scrape type for XC20184: 0
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: TW13952
2026-03-28 07:41:51 [auto1.de] INFO: Found listing with ID: SW03797
2026-03-28 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW03797%27 HTTP/1.1" 200 None
2026-03-28 07:41:52 [auto1.de] INFO: Scrape type for SW03797: 0
2026-03-28 07:41:52 [auto1.de] INFO: Found listing with ID: MG59834
2026-03-28 07:41:52 [auto1.de] INFO: Found listing with ID: UV08426
2026-03-28 07:41:52 [auto1.de] INFO: Found listing with ID: LU31167
2026-03-28 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU31167%27 HTTP/1.1" 200 None
2026-03-28 07:41:52 [auto1.de] INFO: Scrape type for LU31167: 0
2026-03-28 07:41:52 [auto1.de] INFO: Found listing with ID: EK22988
2026-03-28 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK22988%27 HTTP/1.1" 200 None
2026-03-28 07:41:52 [auto1.de] INFO: Scrape type for EK22988: 0
2026-03-28 07:41:52 [auto1.de] INFO: Found listing with ID: DA26658
2026-03-28 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA26658%27 HTTP/1.1" 200 None
2026-03-28 07:41:52 [auto1.de] INFO: Scrape type for DA26658: 0
2026-03-28 07:41:52 [auto1.de] INFO: Found listing with ID: BH17233
2026-03-28 07:41:52 [auto1.de] INFO: Found listing with ID: LN54232
2026-03-28 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN54232%27 HTTP/1.1" 200 None
2026-03-28 07:41:52 [auto1.de] INFO: Scrape type for LN54232: 0
2026-03-28 07:41:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:41:53 [auto1.de] INFO: Channel: 24h | Page: 179 | totalHits: 9264 | hits on page: 40
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: DR69108
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: DD29565
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD29565%27 HTTP/1.1" 200 None
2026-03-28 07:41:53 [auto1.de] INFO: Scrape type for DD29565: 0
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: UL22027
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: PP77608
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: JL94841
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: GA30636
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA30636%27 HTTP/1.1" 200 None
2026-03-28 07:41:53 [auto1.de] INFO: Scrape type for GA30636: 0
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: JZ10962
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: NF93204
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: KK91293
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: DL45560
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL45560%27 HTTP/1.1" 200 None
2026-03-28 07:41:53 [auto1.de] INFO: Scrape type for DL45560: 0
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: RC52895
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC52895%27 HTTP/1.1" 200 None
2026-03-28 07:41:53 [auto1.de] INFO: Scrape type for RC52895: 0
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: UM89266
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM89266%27 HTTP/1.1" 200 None
2026-03-28 07:41:53 [auto1.de] INFO: Scrape type for UM89266: 0
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: CV45473
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: RD20926
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: WY11895
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY11895%27 HTTP/1.1" 200 None
2026-03-28 07:41:53 [auto1.de] INFO: Scrape type for WY11895: 0
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: BE69284
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: VE40725
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE40725%27 HTTP/1.1" 200 None
2026-03-28 07:41:53 [auto1.de] INFO: Scrape type for VE40725: 0
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: KM24929
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: CR35436
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR35436%27 HTTP/1.1" 200 None
2026-03-28 07:41:53 [auto1.de] INFO: Scrape type for CR35436: 0
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: FS97701
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS97701%27 HTTP/1.1" 200 None
2026-03-28 07:41:53 [auto1.de] INFO: Scrape type for FS97701: 0
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: DF26207
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: LL60682
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL60682%27 HTTP/1.1" 200 None
2026-03-28 07:41:53 [auto1.de] INFO: Scrape type for LL60682: 0
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: ZT53548
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT53548%27 HTTP/1.1" 200 None
2026-03-28 07:41:53 [auto1.de] INFO: Scrape type for ZT53548: 0
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: GA77173
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA77173%27 HTTP/1.1" 200 None
2026-03-28 07:41:53 [auto1.de] INFO: Scrape type for GA77173: 0
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: YZ37730
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: ZX84007
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX84007%27 HTTP/1.1" 200 None
2026-03-28 07:41:53 [auto1.de] INFO: Scrape type for ZX84007: 0
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: XX78597
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX78597%27 HTTP/1.1" 200 None
2026-03-28 07:41:53 [auto1.de] INFO: Scrape type for XX78597: 0
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: WG93130
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG93130%27 HTTP/1.1" 200 None
2026-03-28 07:41:53 [auto1.de] INFO: Scrape type for WG93130: 0
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: LN26103
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: AN38948
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: KZ05570
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: YV73538
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV73538%27 HTTP/1.1" 200 None
2026-03-28 07:41:53 [auto1.de] INFO: Scrape type for YV73538: 0
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: LW15406
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: TR74961
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR74961%27 HTTP/1.1" 200 None
2026-03-28 07:41:53 [auto1.de] INFO: Scrape type for TR74961: 0
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: SK54405
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK54405%27 HTTP/1.1" 200 None
2026-03-28 07:41:53 [auto1.de] INFO: Scrape type for SK54405: 0
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: KU78731
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: PN43025
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: TW48699
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: HX62620
2026-03-28 07:41:53 [auto1.de] INFO: Found listing with ID: PD71224
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD71224%27 HTTP/1.1" 200 None
2026-03-28 07:41:53 [auto1.de] INFO: Scrape type for PD71224: 0
2026-03-28 07:41:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:41:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:41:55 [auto1.de] INFO: Channel: 24h | Page: 180 | totalHits: 9264 | hits on page: 40
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: DN90416
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: GG89436
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: SJ33830
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ33830%27 HTTP/1.1" 200 None
2026-03-28 07:41:55 [auto1.de] INFO: Scrape type for SJ33830: 0
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: DD28346
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: NE75834
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: RL39827
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL39827%27 HTTP/1.1" 200 None
2026-03-28 07:41:55 [auto1.de] INFO: Scrape type for RL39827: 0
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: EY95124
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY95124%27 HTTP/1.1" 200 None
2026-03-28 07:41:55 [auto1.de] INFO: Scrape type for EY95124: 0
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: JL21750
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: AB28223
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: DV51967
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: CN50169
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: CM74095
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM74095%27 HTTP/1.1" 200 None
2026-03-28 07:41:55 [auto1.de] INFO: Scrape type for CM74095: 0
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: NC82982
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC82982%27 HTTP/1.1" 200 None
2026-03-28 07:41:55 [auto1.de] INFO: Scrape type for NC82982: 0
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: HH76288
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH76288%27 HTTP/1.1" 200 None
2026-03-28 07:41:55 [auto1.de] INFO: Scrape type for HH76288: 0
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: KX86126
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: SM13407
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: CS81826
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS81826%27 HTTP/1.1" 200 None
2026-03-28 07:41:55 [auto1.de] INFO: Scrape type for CS81826: 0
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: BP61239
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: ZU40216
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: US13530
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US13530%27 HTTP/1.1" 200 None
2026-03-28 07:41:55 [auto1.de] INFO: Scrape type for US13530: 0
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: WF79557
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF79557%27 HTTP/1.1" 200 None
2026-03-28 07:41:55 [auto1.de] INFO: Scrape type for WF79557: 0
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: MY99054
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY99054%27 HTTP/1.1" 200 None
2026-03-28 07:41:55 [auto1.de] INFO: Scrape type for MY99054: 0
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: YP37345
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP37345%27 HTTP/1.1" 200 None
2026-03-28 07:41:55 [auto1.de] INFO: Scrape type for YP37345: 0
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: CY66130
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: GX42293
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX42293%27 HTTP/1.1" 200 None
2026-03-28 07:41:55 [auto1.de] INFO: Scrape type for GX42293: 0
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: FY09014
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: YY09343
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY09343%27 HTTP/1.1" 200 None
2026-03-28 07:41:55 [auto1.de] INFO: Scrape type for YY09343: 0
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: DD20559
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD20559%27 HTTP/1.1" 200 None
2026-03-28 07:41:55 [auto1.de] INFO: Scrape type for DD20559: 0
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: YC44419
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: ML17835
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML17835%27 HTTP/1.1" 200 None
2026-03-28 07:41:55 [auto1.de] INFO: Scrape type for ML17835: 0
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: RW33443
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW33443%27 HTTP/1.1" 200 None
2026-03-28 07:41:55 [auto1.de] INFO: Scrape type for RW33443: 0
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: LH20515
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH20515%27 HTTP/1.1" 200 None
2026-03-28 07:41:55 [auto1.de] INFO: Scrape type for LH20515: 0
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: GW12084
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: CF09149
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF09149%27 HTTP/1.1" 200 None
2026-03-28 07:41:55 [auto1.de] INFO: Scrape type for CF09149: 0
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: SM63646
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: GX96959
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: HN44091
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: YB02361
2026-03-28 07:41:55 [auto1.de] INFO: Found listing with ID: CA34642
2026-03-28 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA34642%27 HTTP/1.1" 200 None
2026-03-28 07:41:56 [auto1.de] INFO: Scrape type for CA34642: 0
2026-03-28 07:41:56 [auto1.de] INFO: Found listing with ID: GL61675
2026-03-28 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL61675%27 HTTP/1.1" 200 None
2026-03-28 07:41:56 [auto1.de] INFO: Scrape type for GL61675: 0
2026-03-28 07:41:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:41:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:41:57 [auto1.de] INFO: Channel: 24h | Page: 181 | totalHits: 9264 | hits on page: 40
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: CM46932
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: AV64816
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: YM55237
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: CL86241
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: JV60507
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: MV67104
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV67104%27 HTTP/1.1" 200 None
2026-03-28 07:41:57 [auto1.de] INFO: Scrape type for MV67104: 0
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: LW56593
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: YB86869
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB86869%27 HTTP/1.1" 200 None
2026-03-28 07:41:57 [auto1.de] INFO: Scrape type for YB86869: 0
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: WS48459
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48459%27 HTTP/1.1" 200 None
2026-03-28 07:41:57 [auto1.de] INFO: Scrape type for WS48459: 0
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: BR64184
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: AY33433
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: HB13325
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB13325%27 HTTP/1.1" 200 None
2026-03-28 07:41:57 [auto1.de] INFO: Scrape type for HB13325: 0
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: TK89149
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK89149%27 HTTP/1.1" 200 None
2026-03-28 07:41:57 [auto1.de] INFO: Scrape type for TK89149: 0
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: FW41048
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW41048%27 HTTP/1.1" 200 None
2026-03-28 07:41:57 [auto1.de] INFO: Scrape type for FW41048: 0
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: CM37211
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: CR26855
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR26855%27 HTTP/1.1" 200 None
2026-03-28 07:41:57 [auto1.de] INFO: Scrape type for CR26855: 0
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: UR07800
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR07800%27 HTTP/1.1" 200 None
2026-03-28 07:41:57 [auto1.de] INFO: Scrape type for UR07800: 0
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: KD93496
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD93496%27 HTTP/1.1" 200 None
2026-03-28 07:41:57 [auto1.de] INFO: Scrape type for KD93496: 0
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: TT11512
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT11512%27 HTTP/1.1" 200 None
2026-03-28 07:41:57 [auto1.de] INFO: Scrape type for TT11512: 0
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: AL86714
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL86714%27 HTTP/1.1" 200 None
2026-03-28 07:41:57 [auto1.de] INFO: Scrape type for AL86714: 0
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: EW17525
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: JA02220
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA02220%27 HTTP/1.1" 200 None
2026-03-28 07:41:57 [auto1.de] INFO: Scrape type for JA02220: 0
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: BC65369
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: VC89740
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: YT58518
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT58518%27 HTTP/1.1" 200 None
2026-03-28 07:41:57 [auto1.de] INFO: Scrape type for YT58518: 0
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: PS82659
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82659%27 HTTP/1.1" 200 None
2026-03-28 07:41:57 [auto1.de] INFO: Scrape type for PS82659: 0
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: CX20587
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: CU12004
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: CT65842
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: PS84197
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: TL84937
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: ZW88785
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: NY75597
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: DP80486
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: UC78580
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: MU16772
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: FY91638
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY91638%27 HTTP/1.1" 200 None
2026-03-28 07:41:57 [auto1.de] INFO: Scrape type for FY91638: 0
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: SJ16961
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: XJ99289
2026-03-28 07:41:57 [auto1.de] INFO: Found listing with ID: BA55761
2026-03-28 07:41:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:41:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:41:59 [auto1.de] INFO: Channel: 24h | Page: 182 | totalHits: 9264 | hits on page: 40
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: VV03137
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV03137%27 HTTP/1.1" 200 None
2026-03-28 07:41:59 [auto1.de] INFO: Scrape type for VV03137: 0
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: VE80218
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE80218%27 HTTP/1.1" 200 None
2026-03-28 07:41:59 [auto1.de] INFO: Scrape type for VE80218: 0
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: GU48092
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: ZS51994
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS51994%27 HTTP/1.1" 200 None
2026-03-28 07:41:59 [auto1.de] INFO: Scrape type for ZS51994: 0
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: VB50178
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: BX54451
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX54451%27 HTTP/1.1" 200 None
2026-03-28 07:41:59 [auto1.de] INFO: Scrape type for BX54451: 0
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: CD76809
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD76809%27 HTTP/1.1" 200 None
2026-03-28 07:41:59 [auto1.de] INFO: Scrape type for CD76809: 0
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: GY67479
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY67479%27 HTTP/1.1" 200 None
2026-03-28 07:41:59 [auto1.de] INFO: Scrape type for GY67479: 0
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: ZY31624
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: VU29174
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU29174%27 HTTP/1.1" 200 None
2026-03-28 07:41:59 [auto1.de] INFO: Scrape type for VU29174: 0
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: VN30485
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: NP21854
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: NT84064
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: DV65946
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV65946%27 HTTP/1.1" 200 None
2026-03-28 07:41:59 [auto1.de] INFO: Scrape type for DV65946: 0
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: KJ75418
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ75418%27 HTTP/1.1" 200 None
2026-03-28 07:41:59 [auto1.de] INFO: Scrape type for KJ75418: 0
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: NT27020
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT27020%27 HTTP/1.1" 200 None
2026-03-28 07:41:59 [auto1.de] INFO: Scrape type for NT27020: 0
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: FU39624
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: JE20553
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE20553%27 HTTP/1.1" 200 None
2026-03-28 07:41:59 [auto1.de] INFO: Scrape type for JE20553: 0
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: CY50821
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY50821%27 HTTP/1.1" 200 None
2026-03-28 07:41:59 [auto1.de] INFO: Scrape type for CY50821: 0
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: NB66943
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB66943%27 HTTP/1.1" 200 None
2026-03-28 07:41:59 [auto1.de] INFO: Scrape type for NB66943: 0
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: AL15511
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: NK75745
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: XT22823
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT22823%27 HTTP/1.1" 200 None
2026-03-28 07:41:59 [auto1.de] INFO: Scrape type for XT22823: 0
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: AX94045
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX94045%27 HTTP/1.1" 200 None
2026-03-28 07:41:59 [auto1.de] INFO: Scrape type for AX94045: 0
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: DZ46281
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: XF90946
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF90946%27 HTTP/1.1" 200 None
2026-03-28 07:41:59 [auto1.de] INFO: Scrape type for XF90946: 0
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: TL65156
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL65156%27 HTTP/1.1" 200 None
2026-03-28 07:41:59 [auto1.de] INFO: Scrape type for TL65156: 0
2026-03-28 07:41:59 [auto1.de] INFO: Found listing with ID: JG55591
2026-03-28 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG55591%27 HTTP/1.1" 200 None
2026-03-28 07:42:00 [auto1.de] INFO: Scrape type for JG55591: 0
2026-03-28 07:42:00 [auto1.de] INFO: Found listing with ID: ZF74811
2026-03-28 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF74811%27 HTTP/1.1" 200 None
2026-03-28 07:42:00 [auto1.de] INFO: Scrape type for ZF74811: 0
2026-03-28 07:42:00 [auto1.de] INFO: Found listing with ID: NJ92771
2026-03-28 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ92771%27 HTTP/1.1" 200 None
2026-03-28 07:42:00 [auto1.de] INFO: Scrape type for NJ92771: 0
2026-03-28 07:42:00 [auto1.de] INFO: Found listing with ID: YP93259
2026-03-28 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP93259%27 HTTP/1.1" 200 None
2026-03-28 07:42:00 [auto1.de] INFO: Scrape type for YP93259: 0
2026-03-28 07:42:00 [auto1.de] INFO: Found listing with ID: NW62126
2026-03-28 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW62126%27 HTTP/1.1" 200 None
2026-03-28 07:42:00 [auto1.de] INFO: Scrape type for NW62126: 0
2026-03-28 07:42:00 [auto1.de] INFO: Found listing with ID: SC45462
2026-03-28 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC45462%27 HTTP/1.1" 200 None
2026-03-28 07:42:00 [auto1.de] INFO: Scrape type for SC45462: 0
2026-03-28 07:42:00 [auto1.de] INFO: Found listing with ID: VH75951
2026-03-28 07:42:00 [auto1.de] INFO: Found listing with ID: UA59851
2026-03-28 07:42:00 [auto1.de] INFO: Found listing with ID: EL92267
2026-03-28 07:42:00 [auto1.de] INFO: Found listing with ID: XU09743
2026-03-28 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU09743%27 HTTP/1.1" 200 None
2026-03-28 07:42:00 [auto1.de] INFO: Scrape type for XU09743: 0
2026-03-28 07:42:00 [auto1.de] INFO: Found listing with ID: ZP66388
2026-03-28 07:42:00 [auto1.de] INFO: Found listing with ID: DW69161
2026-03-28 07:42:00 [auto1.de] INFO: Found listing with ID: UC31654
2026-03-28 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC31654%27 HTTP/1.1" 200 None
2026-03-28 07:42:00 [auto1.de] INFO: Scrape type for UC31654: 0
2026-03-28 07:42:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:01 [auto1.de] INFO: Channel: 24h | Page: 183 | totalHits: 9264 | hits on page: 40
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: BK25487
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: FU90427
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU90427%27 HTTP/1.1" 200 None
2026-03-28 07:42:01 [auto1.de] INFO: Scrape type for FU90427: 0
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: AE68342
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE68342%27 HTTP/1.1" 200 None
2026-03-28 07:42:01 [auto1.de] INFO: Scrape type for AE68342: 0
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: LV55380
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: DZ84842
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: CC98998
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC98998%27 HTTP/1.1" 200 None
2026-03-28 07:42:01 [auto1.de] INFO: Scrape type for CC98998: 0
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: EP30050
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: DB64139
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: BX11616
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: PX02497
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX02497%27 HTTP/1.1" 200 None
2026-03-28 07:42:01 [auto1.de] INFO: Scrape type for PX02497: 0
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: AX67376
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX67376%27 HTTP/1.1" 200 None
2026-03-28 07:42:01 [auto1.de] INFO: Scrape type for AX67376: 0
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: FT28462
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: TN63570
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: KE72170
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE72170%27 HTTP/1.1" 200 None
2026-03-28 07:42:01 [auto1.de] INFO: Scrape type for KE72170: 0
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: KY02769
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY02769%27 HTTP/1.1" 200 None
2026-03-28 07:42:01 [auto1.de] INFO: Scrape type for KY02769: 0
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: WK96887
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: MJ16162
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: FU53159
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: BU39152
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU39152%27 HTTP/1.1" 200 None
2026-03-28 07:42:01 [auto1.de] INFO: Scrape type for BU39152: 0
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: EM38204
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM38204%27 HTTP/1.1" 200 None
2026-03-28 07:42:01 [auto1.de] INFO: Scrape type for EM38204: 0
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: CA54240
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: VW08133
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: PA10723
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: LC14083
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC14083%27 HTTP/1.1" 200 None
2026-03-28 07:42:01 [auto1.de] INFO: Scrape type for LC14083: 0
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: PM13070
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM13070%27 HTTP/1.1" 200 None
2026-03-28 07:42:01 [auto1.de] INFO: Scrape type for PM13070: 0
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: FN69423
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN69423%27 HTTP/1.1" 200 None
2026-03-28 07:42:01 [auto1.de] INFO: Scrape type for FN69423: 0
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: XW22041
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: WC45623
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC45623%27 HTTP/1.1" 200 None
2026-03-28 07:42:01 [auto1.de] INFO: Scrape type for WC45623: 0
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: EF60692
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: SS31762
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: SX72009
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: XM14327
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: DR21754
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: FC27244
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC27244%27 HTTP/1.1" 200 None
2026-03-28 07:42:01 [auto1.de] INFO: Scrape type for FC27244: 0
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: AU35390
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: AG34789
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG34789%27 HTTP/1.1" 200 None
2026-03-28 07:42:01 [auto1.de] INFO: Scrape type for AG34789: 0
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: YL43717
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: UE90964
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE90964%27 HTTP/1.1" 200 None
2026-03-28 07:42:01 [auto1.de] INFO: Scrape type for UE90964: 0
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: FH11160
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH11160%27 HTTP/1.1" 200 None
2026-03-28 07:42:01 [auto1.de] INFO: Scrape type for FH11160: 0
2026-03-28 07:42:01 [auto1.de] INFO: Found listing with ID: DM70837
2026-03-28 07:42:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:02 [auto1.de] INFO: Channel: 24h | Page: 184 | totalHits: 9264 | hits on page: 40
2026-03-28 07:42:02 [auto1.de] INFO: Found listing with ID: MS43037
2026-03-28 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS43037%27 HTTP/1.1" 200 None
2026-03-28 07:42:02 [auto1.de] INFO: Scrape type for MS43037: 0
2026-03-28 07:42:02 [auto1.de] INFO: Found listing with ID: MV55154
2026-03-28 07:42:02 [auto1.de] INFO: Found listing with ID: MH34813
2026-03-28 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH34813%27 HTTP/1.1" 200 None
2026-03-28 07:42:02 [auto1.de] INFO: Scrape type for MH34813: 0
2026-03-28 07:42:02 [auto1.de] INFO: Found listing with ID: ZM43235
2026-03-28 07:42:02 [auto1.de] INFO: Found listing with ID: CH75769
2026-03-28 07:42:02 [auto1.de] INFO: Found listing with ID: VR01853
2026-03-28 07:42:02 [auto1.de] INFO: Found listing with ID: SJ26339
2026-03-28 07:42:02 [auto1.de] INFO: Found listing with ID: VR25014
2026-03-28 07:42:02 [auto1.de] INFO: Found listing with ID: AX71998
2026-03-28 07:42:02 [auto1.de] INFO: Found listing with ID: WL85831
2026-03-28 07:42:02 [auto1.de] INFO: Found listing with ID: LW05271
2026-03-28 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW05271%27 HTTP/1.1" 200 None
2026-03-28 07:42:02 [auto1.de] INFO: Scrape type for LW05271: 0
2026-03-28 07:42:02 [auto1.de] INFO: Found listing with ID: MS67551
2026-03-28 07:42:02 [auto1.de] INFO: Found listing with ID: FP53719
2026-03-28 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP53719%27 HTTP/1.1" 200 None
2026-03-28 07:42:02 [auto1.de] INFO: Scrape type for FP53719: 0
2026-03-28 07:42:02 [auto1.de] INFO: Found listing with ID: PN41265
2026-03-28 07:42:02 [auto1.de] INFO: Found listing with ID: UB50562
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: TA30893
2026-03-28 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA30893%27 HTTP/1.1" 200 None
2026-03-28 07:42:03 [auto1.de] INFO: Scrape type for TA30893: 0
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: GP54397
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: WT01639
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: NV84142
2026-03-28 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV84142%27 HTTP/1.1" 200 None
2026-03-28 07:42:03 [auto1.de] INFO: Scrape type for NV84142: 0
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: CJ94447
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: JM79272
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: DS08913
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: EX24606
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: AE65824
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: GE88369
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: RZ09497
2026-03-28 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ09497%27 HTTP/1.1" 200 None
2026-03-28 07:42:03 [auto1.de] INFO: Scrape type for RZ09497: 0
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: TG88062
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: YU99321
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: DB28845
2026-03-28 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB28845%27 HTTP/1.1" 200 None
2026-03-28 07:42:03 [auto1.de] INFO: Scrape type for DB28845: 0
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: PR23658
2026-03-28 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR23658%27 HTTP/1.1" 200 None
2026-03-28 07:42:03 [auto1.de] INFO: Scrape type for PR23658: 0
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: BV38151
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: UW23884
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: UC14078
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: KW68536
2026-03-28 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW68536%27 HTTP/1.1" 200 None
2026-03-28 07:42:03 [auto1.de] INFO: Scrape type for KW68536: 0
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: BF27156
2026-03-28 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF27156%27 HTTP/1.1" 200 None
2026-03-28 07:42:03 [auto1.de] INFO: Scrape type for BF27156: 0
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: XG19073
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: BA31495
2026-03-28 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA31495%27 HTTP/1.1" 200 None
2026-03-28 07:42:03 [auto1.de] INFO: Scrape type for BA31495: 0
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: VW39086
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: TL76772
2026-03-28 07:42:03 [auto1.de] INFO: Found listing with ID: MA61541
2026-03-28 07:42:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:05 [auto1.de] INFO: Channel: 24h | Page: 185 | totalHits: 9264 | hits on page: 40
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: HR13595
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR13595%27 HTTP/1.1" 200 None
2026-03-28 07:42:05 [auto1.de] INFO: Scrape type for HR13595: 0
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: KE98572
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE98572%27 HTTP/1.1" 200 None
2026-03-28 07:42:05 [auto1.de] INFO: Scrape type for KE98572: 0
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: UW78098
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW78098%27 HTTP/1.1" 200 None
2026-03-28 07:42:05 [auto1.de] INFO: Scrape type for UW78098: 0
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: VV99941
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV99941%27 HTTP/1.1" 200 None
2026-03-28 07:42:05 [auto1.de] INFO: Scrape type for VV99941: 0
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: BY90710
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: KV84804
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: VA07254
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA07254%27 HTTP/1.1" 200 None
2026-03-28 07:42:05 [auto1.de] INFO: Scrape type for VA07254: 0
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: CR70146
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: MT40428
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT40428%27 HTTP/1.1" 200 None
2026-03-28 07:42:05 [auto1.de] INFO: Scrape type for MT40428: 0
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: HZ16106
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ16106%27 HTTP/1.1" 200 None
2026-03-28 07:42:05 [auto1.de] INFO: Scrape type for HZ16106: 0
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: YJ47160
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ47160%27 HTTP/1.1" 200 None
2026-03-28 07:42:05 [auto1.de] INFO: Scrape type for YJ47160: 0
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: GL07101
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL07101%27 HTTP/1.1" 200 None
2026-03-28 07:42:05 [auto1.de] INFO: Scrape type for GL07101: 0
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: JM16548
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: HT61440
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT61440%27 HTTP/1.1" 200 None
2026-03-28 07:42:05 [auto1.de] INFO: Scrape type for HT61440: 0
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: GX89038
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX89038%27 HTTP/1.1" 200 None
2026-03-28 07:42:05 [auto1.de] INFO: Scrape type for GX89038: 0
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: NL88078
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL88078%27 HTTP/1.1" 200 None
2026-03-28 07:42:05 [auto1.de] INFO: Scrape type for NL88078: 0
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: KL79607
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: VZ21746
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: DC30039
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: PD92865
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD92865%27 HTTP/1.1" 200 None
2026-03-28 07:42:05 [auto1.de] INFO: Scrape type for PD92865: 0
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: CK72953
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: TR81409
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: MN30127
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN30127%27 HTTP/1.1" 200 None
2026-03-28 07:42:05 [auto1.de] INFO: Scrape type for MN30127: 0
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: GC04938
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: TF66313
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF66313%27 HTTP/1.1" 200 None
2026-03-28 07:42:05 [auto1.de] INFO: Scrape type for TF66313: 0
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: FV94610
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: SM54936
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: CZ12085
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ12085%27 HTTP/1.1" 200 None
2026-03-28 07:42:05 [auto1.de] INFO: Scrape type for CZ12085: 0
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: EA80690
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: RV26500
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: YA08912
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08912%27 HTTP/1.1" 200 None
2026-03-28 07:42:05 [auto1.de] INFO: Scrape type for YA08912: 0
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: CJ52783
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ52783%27 HTTP/1.1" 200 None
2026-03-28 07:42:05 [auto1.de] INFO: Scrape type for CJ52783: 0
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: NG80154
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: WT06572
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: EH62859
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH62859%27 HTTP/1.1" 200 None
2026-03-28 07:42:05 [auto1.de] INFO: Scrape type for EH62859: 0
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: FY64526
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY64526%27 HTTP/1.1" 200 None
2026-03-28 07:42:05 [auto1.de] INFO: Scrape type for FY64526: 0
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: GX15527
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX15527%27 HTTP/1.1" 200 None
2026-03-28 07:42:05 [auto1.de] INFO: Scrape type for GX15527: 0
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: YL92844
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL92844%27 HTTP/1.1" 200 None
2026-03-28 07:42:05 [auto1.de] INFO: Scrape type for YL92844: 0
2026-03-28 07:42:05 [auto1.de] INFO: Found listing with ID: WG78869
2026-03-28 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78869%27 HTTP/1.1" 200 None
2026-03-28 07:42:06 [auto1.de] INFO: Scrape type for WG78869: 0
2026-03-28 07:42:06 [auto1.de] INFO: Found listing with ID: BX52233
2026-03-28 07:42:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:06 [scrapy.extensions.logstats] INFO: Crawled 191 pages (at 25 pages/min), scraped 475 items (at 0 items/min)
2026-03-28 07:42:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 165MiB
2026-03-28 07:42:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:08 [auto1.de] INFO: Channel: 24h | Page: 186 | totalHits: 9264 | hits on page: 40
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: WM31367
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM31367%27 HTTP/1.1" 200 None
2026-03-28 07:42:08 [auto1.de] INFO: Scrape type for WM31367: 0
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: VH10355
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: MG37810
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG37810%27 HTTP/1.1" 200 None
2026-03-28 07:42:08 [auto1.de] INFO: Scrape type for MG37810: 0
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: NK83819
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK83819%27 HTTP/1.1" 200 None
2026-03-28 07:42:08 [auto1.de] INFO: Scrape type for NK83819: 0
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: SV13508
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: UP84428
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: TE41931
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE41931%27 HTTP/1.1" 200 None
2026-03-28 07:42:08 [auto1.de] INFO: Scrape type for TE41931: 0
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: PD33755
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD33755%27 HTTP/1.1" 200 None
2026-03-28 07:42:08 [auto1.de] INFO: Scrape type for PD33755: 0
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: BN83173
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: MW31978
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW31978%27 HTTP/1.1" 200 None
2026-03-28 07:42:08 [auto1.de] INFO: Scrape type for MW31978: 0
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: CS48399
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: WM50806
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM50806%27 HTTP/1.1" 200 None
2026-03-28 07:42:08 [auto1.de] INFO: Scrape type for WM50806: 0
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: VM88505
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: FJ71041
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71041%27 HTTP/1.1" 200 None
2026-03-28 07:42:08 [auto1.de] INFO: Scrape type for FJ71041: 0
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: RT27360
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT27360%27 HTTP/1.1" 200 None
2026-03-28 07:42:08 [auto1.de] INFO: Scrape type for RT27360: 0
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: RP72323
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: LA39027
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: MW80784
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: EM63340
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM63340%27 HTTP/1.1" 200 None
2026-03-28 07:42:08 [auto1.de] INFO: Scrape type for EM63340: 0
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: TL42173
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL42173%27 HTTP/1.1" 200 None
2026-03-28 07:42:08 [auto1.de] INFO: Scrape type for TL42173: 0
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: HB95489
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: DZ70756
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: MB94614
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB94614%27 HTTP/1.1" 200 None
2026-03-28 07:42:08 [auto1.de] INFO: Scrape type for MB94614: 0
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: TG96584
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: KY59799
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: NG10221
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: ZK28238
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK28238%27 HTTP/1.1" 200 None
2026-03-28 07:42:08 [auto1.de] INFO: Scrape type for ZK28238: 0
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: YW88691
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW88691%27 HTTP/1.1" 200 None
2026-03-28 07:42:08 [auto1.de] INFO: Scrape type for YW88691: 0
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: RE17232
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17232%27 HTTP/1.1" 200 None
2026-03-28 07:42:08 [auto1.de] INFO: Scrape type for RE17232: 0
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: HK36179
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: UE30876
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE30876%27 HTTP/1.1" 200 None
2026-03-28 07:42:08 [auto1.de] INFO: Scrape type for UE30876: 0
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: DF69059
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF69059%27 HTTP/1.1" 200 None
2026-03-28 07:42:08 [auto1.de] INFO: Scrape type for DF69059: 0
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: HV45616
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: XT42199
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: WG00954
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG00954%27 HTTP/1.1" 200 None
2026-03-28 07:42:08 [auto1.de] INFO: Scrape type for WG00954: 0
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: ZK69536
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK69536%27 HTTP/1.1" 200 None
2026-03-28 07:42:08 [auto1.de] INFO: Scrape type for ZK69536: 0
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: AW78451
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: BD44201
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD44201%27 HTTP/1.1" 200 None
2026-03-28 07:42:08 [auto1.de] INFO: Scrape type for BD44201: 0
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: SV60739
2026-03-28 07:42:08 [auto1.de] INFO: Found listing with ID: SZ69357
2026-03-28 07:42:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:09 [auto1.de] INFO: Channel: 24h | Page: 187 | totalHits: 9264 | hits on page: 40
2026-03-28 07:42:09 [auto1.de] INFO: Found listing with ID: YU03537
2026-03-28 07:42:09 [auto1.de] INFO: Found listing with ID: EN83370
2026-03-28 07:42:09 [auto1.de] INFO: Found listing with ID: NG01563
2026-03-28 07:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG01563%27 HTTP/1.1" 200 None
2026-03-28 07:42:09 [auto1.de] INFO: Scrape type for NG01563: 0
2026-03-28 07:42:09 [auto1.de] INFO: Found listing with ID: NB27251
2026-03-28 07:42:09 [auto1.de] INFO: Found listing with ID: XX11179
2026-03-28 07:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX11179%27 HTTP/1.1" 200 None
2026-03-28 07:42:09 [auto1.de] INFO: Scrape type for XX11179: 0
2026-03-28 07:42:09 [auto1.de] INFO: Found listing with ID: YP91741
2026-03-28 07:42:09 [auto1.de] INFO: Found listing with ID: LS95970
2026-03-28 07:42:09 [auto1.de] INFO: Found listing with ID: ML63417
2026-03-28 07:42:09 [auto1.de] INFO: Found listing with ID: HK63697
2026-03-28 07:42:09 [auto1.de] INFO: Found listing with ID: ZB26924
2026-03-28 07:42:09 [auto1.de] INFO: Found listing with ID: AN46464
2026-03-28 07:42:09 [auto1.de] INFO: Found listing with ID: AU27688
2026-03-28 07:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU27688%27 HTTP/1.1" 200 None
2026-03-28 07:42:09 [auto1.de] INFO: Scrape type for AU27688: 0
2026-03-28 07:42:09 [auto1.de] INFO: Found listing with ID: RM96597
2026-03-28 07:42:09 [auto1.de] INFO: Found listing with ID: JU23189
2026-03-28 07:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU23189%27 HTTP/1.1" 200 None
2026-03-28 07:42:09 [auto1.de] INFO: Scrape type for JU23189: 0
2026-03-28 07:42:09 [auto1.de] INFO: Found listing with ID: LW83066
2026-03-28 07:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW83066%27 HTTP/1.1" 200 None
2026-03-28 07:42:09 [auto1.de] INFO: Scrape type for LW83066: 0
2026-03-28 07:42:09 [auto1.de] INFO: Found listing with ID: LX68947
2026-03-28 07:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX68947%27 HTTP/1.1" 200 None
2026-03-28 07:42:09 [auto1.de] INFO: Scrape type for LX68947: 0
2026-03-28 07:42:09 [auto1.de] INFO: Found listing with ID: CT44889
2026-03-28 07:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT44889%27 HTTP/1.1" 200 None
2026-03-28 07:42:09 [auto1.de] INFO: Scrape type for CT44889: 0
2026-03-28 07:42:09 [auto1.de] INFO: Found listing with ID: LN38152
2026-03-28 07:42:09 [auto1.de] INFO: Found listing with ID: GS69685
2026-03-28 07:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS69685%27 HTTP/1.1" 200 None
2026-03-28 07:42:09 [auto1.de] INFO: Scrape type for GS69685: 0
2026-03-28 07:42:09 [auto1.de] INFO: Found listing with ID: AE12757
2026-03-28 07:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE12757%27 HTTP/1.1" 200 None
2026-03-28 07:42:10 [auto1.de] INFO: Scrape type for AE12757: 0
2026-03-28 07:42:10 [auto1.de] INFO: Found listing with ID: ZE90376
2026-03-28 07:42:10 [auto1.de] INFO: Found listing with ID: TS36559
2026-03-28 07:42:10 [auto1.de] INFO: Found listing with ID: EU51889
2026-03-28 07:42:10 [auto1.de] INFO: Found listing with ID: AU97195
2026-03-28 07:42:10 [auto1.de] INFO: Found listing with ID: NC61336
2026-03-28 07:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC61336%27 HTTP/1.1" 200 None
2026-03-28 07:42:10 [auto1.de] INFO: Scrape type for NC61336: 0
2026-03-28 07:42:10 [auto1.de] INFO: Found listing with ID: FZ16195
2026-03-28 07:42:10 [auto1.de] INFO: Found listing with ID: BP38143
2026-03-28 07:42:10 [auto1.de] INFO: Found listing with ID: HV64790
2026-03-28 07:42:10 [auto1.de] INFO: Found listing with ID: BT35414
2026-03-28 07:42:10 [auto1.de] INFO: Found listing with ID: TT67708
2026-03-28 07:42:10 [auto1.de] INFO: Found listing with ID: BY27711
2026-03-28 07:42:10 [auto1.de] INFO: Found listing with ID: NE15652
2026-03-28 07:42:10 [auto1.de] INFO: Found listing with ID: UZ82929
2026-03-28 07:42:10 [auto1.de] INFO: Found listing with ID: LH67751
2026-03-28 07:42:10 [auto1.de] INFO: Found listing with ID: CK79873
2026-03-28 07:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK79873%27 HTTP/1.1" 200 None
2026-03-28 07:42:10 [auto1.de] INFO: Scrape type for CK79873: 0
2026-03-28 07:42:10 [auto1.de] INFO: Found listing with ID: EC33750
2026-03-28 07:42:10 [auto1.de] INFO: Found listing with ID: TS01373
2026-03-28 07:42:10 [auto1.de] INFO: Found listing with ID: FX17488
2026-03-28 07:42:10 [auto1.de] INFO: Found listing with ID: JG50197
2026-03-28 07:42:10 [auto1.de] INFO: Found listing with ID: CD24001
2026-03-28 07:42:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:11 [auto1.de] INFO: Channel: 24h | Page: 188 | totalHits: 9265 | hits on page: 40
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: CD24001
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: MV69505
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV69505%27 HTTP/1.1" 200 None
2026-03-28 07:42:11 [auto1.de] INFO: Scrape type for MV69505: 0
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: JJ72083
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: GB33155
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: FR69790
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: KS26285
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS26285%27 HTTP/1.1" 200 None
2026-03-28 07:42:11 [auto1.de] INFO: Scrape type for KS26285: 0
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: NH03698
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH03698%27 HTTP/1.1" 200 None
2026-03-28 07:42:11 [auto1.de] INFO: Scrape type for NH03698: 0
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: SC33158
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC33158%27 HTTP/1.1" 200 None
2026-03-28 07:42:11 [auto1.de] INFO: Scrape type for SC33158: 0
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: WY54008
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY54008%27 HTTP/1.1" 200 None
2026-03-28 07:42:11 [auto1.de] INFO: Scrape type for WY54008: 0
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: WE78461
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE78461%27 HTTP/1.1" 200 None
2026-03-28 07:42:11 [auto1.de] INFO: Scrape type for WE78461: 0
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: XX31314
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX31314%27 HTTP/1.1" 200 None
2026-03-28 07:42:11 [auto1.de] INFO: Scrape type for XX31314: 0
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: ZA85073
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: SM20101
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: UK16576
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK16576%27 HTTP/1.1" 200 None
2026-03-28 07:42:11 [auto1.de] INFO: Scrape type for UK16576: 0
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: BR69139
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: JW75116
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: HL17570
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL17570%27 HTTP/1.1" 200 None
2026-03-28 07:42:11 [auto1.de] INFO: Scrape type for HL17570: 0
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: PH87632
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: BZ40542
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: KP27245
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP27245%27 HTTP/1.1" 200 None
2026-03-28 07:42:11 [auto1.de] INFO: Scrape type for KP27245: 0
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: NU23717
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: GC84828
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: LF68869
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF68869%27 HTTP/1.1" 200 None
2026-03-28 07:42:11 [auto1.de] INFO: Scrape type for LF68869: 0
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: HF06660
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF06660%27 HTTP/1.1" 200 None
2026-03-28 07:42:11 [auto1.de] INFO: Scrape type for HF06660: 0
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: UB26055
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: LG85121
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: CR88792
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: RF57736
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: GY26864
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY26864%27 HTTP/1.1" 200 None
2026-03-28 07:42:11 [auto1.de] INFO: Scrape type for GY26864: 0
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: JL47940
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL47940%27 HTTP/1.1" 200 None
2026-03-28 07:42:11 [auto1.de] INFO: Scrape type for JL47940: 0
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: VT76935
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT76935%27 HTTP/1.1" 200 None
2026-03-28 07:42:11 [auto1.de] INFO: Scrape type for VT76935: 0
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: ZD23716
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD23716%27 HTTP/1.1" 200 None
2026-03-28 07:42:11 [auto1.de] INFO: Scrape type for ZD23716: 0
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: ZG00412
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG00412%27 HTTP/1.1" 200 None
2026-03-28 07:42:11 [auto1.de] INFO: Scrape type for ZG00412: 0
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: XL45586
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL45586%27 HTTP/1.1" 200 None
2026-03-28 07:42:11 [auto1.de] INFO: Scrape type for XL45586: 0
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: MC50567
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC50567%27 HTTP/1.1" 200 None
2026-03-28 07:42:11 [auto1.de] INFO: Scrape type for MC50567: 0
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: RG24592
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: MK74159
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK74159%27 HTTP/1.1" 200 None
2026-03-28 07:42:11 [auto1.de] INFO: Scrape type for MK74159: 0
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: BE15343
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: JZ96778
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ96778%27 HTTP/1.1" 200 None
2026-03-28 07:42:11 [auto1.de] INFO: Scrape type for JZ96778: 0
2026-03-28 07:42:11 [auto1.de] INFO: Found listing with ID: CK62580
2026-03-28 07:42:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:12 [auto1.de] INFO: Channel: 24h | Page: 189 | totalHits: 9265 | hits on page: 40
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: GB74339
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB74339%27 HTTP/1.1" 200 None
2026-03-28 07:42:12 [auto1.de] INFO: Scrape type for GB74339: 0
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: ZP86837
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: YS13064
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS13064%27 HTTP/1.1" 200 None
2026-03-28 07:42:12 [auto1.de] INFO: Scrape type for YS13064: 0
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: DW23670
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW23670%27 HTTP/1.1" 200 None
2026-03-28 07:42:12 [auto1.de] INFO: Scrape type for DW23670: 0
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: TL45864
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL45864%27 HTTP/1.1" 200 None
2026-03-28 07:42:12 [auto1.de] INFO: Scrape type for TL45864: 0
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: BD42318
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: BE44691
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE44691%27 HTTP/1.1" 200 None
2026-03-28 07:42:12 [auto1.de] INFO: Scrape type for BE44691: 0
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: JM99769
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM99769%27 HTTP/1.1" 200 None
2026-03-28 07:42:12 [auto1.de] INFO: Scrape type for JM99769: 0
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: WR03810
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: YR74432
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: PR23937
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: GB59587
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB59587%27 HTTP/1.1" 200 None
2026-03-28 07:42:12 [auto1.de] INFO: Scrape type for GB59587: 0
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: WN28352
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: FX80624
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX80624%27 HTTP/1.1" 200 None
2026-03-28 07:42:12 [auto1.de] INFO: Scrape type for FX80624: 0
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: AF42457
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF42457%27 HTTP/1.1" 200 None
2026-03-28 07:42:12 [auto1.de] INFO: Scrape type for AF42457: 0
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: JD23896
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: WZ14073
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: ES42650
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES42650%27 HTTP/1.1" 200 None
2026-03-28 07:42:12 [auto1.de] INFO: Scrape type for ES42650: 0
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: JB03726
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: EA13561
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA13561%27 HTTP/1.1" 200 None
2026-03-28 07:42:12 [auto1.de] INFO: Scrape type for EA13561: 0
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: GJ05712
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: KK06519
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: KT29520
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: AB35938
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: GH02109
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH02109%27 HTTP/1.1" 200 None
2026-03-28 07:42:12 [auto1.de] INFO: Scrape type for GH02109: 0
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: TR96754
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR96754%27 HTTP/1.1" 200 None
2026-03-28 07:42:12 [auto1.de] INFO: Scrape type for TR96754: 0
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: RP70991
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: SS89253
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS89253%27 HTTP/1.1" 200 None
2026-03-28 07:42:12 [auto1.de] INFO: Scrape type for SS89253: 0
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: TX63688
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: SM09769
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: HY59950
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: JN13946
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN13946%27 HTTP/1.1" 200 None
2026-03-28 07:42:12 [auto1.de] INFO: Scrape type for JN13946: 0
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: TP66547
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: PV56207
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV56207%27 HTTP/1.1" 200 None
2026-03-28 07:42:12 [auto1.de] INFO: Scrape type for PV56207: 0
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: JS13151
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS13151%27 HTTP/1.1" 200 None
2026-03-28 07:42:12 [auto1.de] INFO: Scrape type for JS13151: 0
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: WR99181
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR99181%27 HTTP/1.1" 200 None
2026-03-28 07:42:12 [auto1.de] INFO: Scrape type for WR99181: 0
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: HY06483
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: VT05460
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT05460%27 HTTP/1.1" 200 None
2026-03-28 07:42:12 [auto1.de] INFO: Scrape type for VT05460: 0
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: LV46830
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV46830%27 HTTP/1.1" 200 None
2026-03-28 07:42:12 [auto1.de] INFO: Scrape type for LV46830: 0
2026-03-28 07:42:12 [auto1.de] INFO: Found listing with ID: SJ46577
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ46577%27 HTTP/1.1" 200 None
2026-03-28 07:42:12 [auto1.de] INFO: Scrape type for SJ46577: 0
2026-03-28 07:42:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:13 [auto1.de] INFO: Channel: 24h | Page: 190 | totalHits: 9265 | hits on page: 40
2026-03-28 07:42:13 [auto1.de] INFO: Found listing with ID: HR97485
2026-03-28 07:42:13 [auto1.de] INFO: Found listing with ID: FE22716
2026-03-28 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE22716%27 HTTP/1.1" 200 None
2026-03-28 07:42:13 [auto1.de] INFO: Scrape type for FE22716: 0
2026-03-28 07:42:13 [auto1.de] INFO: Found listing with ID: VM88719
2026-03-28 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM88719%27 HTTP/1.1" 200 None
2026-03-28 07:42:13 [auto1.de] INFO: Scrape type for VM88719: 0
2026-03-28 07:42:13 [auto1.de] INFO: Found listing with ID: BB84550
2026-03-28 07:42:13 [auto1.de] INFO: Found listing with ID: BJ13428
2026-03-28 07:42:13 [auto1.de] INFO: Found listing with ID: MY92722
2026-03-28 07:42:13 [auto1.de] INFO: Found listing with ID: YV97613
2026-03-28 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV97613%27 HTTP/1.1" 200 None
2026-03-28 07:42:13 [auto1.de] INFO: Scrape type for YV97613: 0
2026-03-28 07:42:13 [auto1.de] INFO: Found listing with ID: PT90816
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT90816%27 HTTP/1.1" 200 None
2026-03-28 07:42:14 [auto1.de] INFO: Scrape type for PT90816: 0
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: ME89657
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: JY33610
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY33610%27 HTTP/1.1" 200 None
2026-03-28 07:42:14 [auto1.de] INFO: Scrape type for JY33610: 0
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: ZC71941
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: DW75956
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW75956%27 HTTP/1.1" 200 None
2026-03-28 07:42:14 [auto1.de] INFO: Scrape type for DW75956: 0
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: RC49554
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: XG24427
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: RY74387
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: JT94626
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT94626%27 HTTP/1.1" 200 None
2026-03-28 07:42:14 [auto1.de] INFO: Scrape type for JT94626: 0
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: XK99060
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK99060%27 HTTP/1.1" 200 None
2026-03-28 07:42:14 [auto1.de] INFO: Scrape type for XK99060: 0
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: YG21382
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: DY27021
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: SA10285
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA10285%27 HTTP/1.1" 200 None
2026-03-28 07:42:14 [auto1.de] INFO: Scrape type for SA10285: 0
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: RA54991
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: EN90928
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN90928%27 HTTP/1.1" 200 None
2026-03-28 07:42:14 [auto1.de] INFO: Scrape type for EN90928: 0
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: LA44092
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA44092%27 HTTP/1.1" 200 None
2026-03-28 07:42:14 [auto1.de] INFO: Scrape type for LA44092: 0
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: JL12737
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL12737%27 HTTP/1.1" 200 None
2026-03-28 07:42:14 [auto1.de] INFO: Scrape type for JL12737: 0
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: GL18465
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: AX51342
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX51342%27 HTTP/1.1" 200 None
2026-03-28 07:42:14 [auto1.de] INFO: Scrape type for AX51342: 0
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: HJ55484
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ55484%27 HTTP/1.1" 200 None
2026-03-28 07:42:14 [auto1.de] INFO: Scrape type for HJ55484: 0
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: PB35846
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: MW22662
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW22662%27 HTTP/1.1" 200 None
2026-03-28 07:42:14 [auto1.de] INFO: Scrape type for MW22662: 0
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: HB69443
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB69443%27 HTTP/1.1" 200 None
2026-03-28 07:42:14 [auto1.de] INFO: Scrape type for HB69443: 0
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: MV22283
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV22283%27 HTTP/1.1" 200 None
2026-03-28 07:42:14 [auto1.de] INFO: Scrape type for MV22283: 0
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: LM85601
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: WT41205
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT41205%27 HTTP/1.1" 200 None
2026-03-28 07:42:14 [auto1.de] INFO: Scrape type for WT41205: 0
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: RM51665
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: DA44697
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: NL59666
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: MN72943
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: AU24928
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU24928%27 HTTP/1.1" 200 None
2026-03-28 07:42:14 [auto1.de] INFO: Scrape type for AU24928: 0
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: BK59777
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK59777%27 HTTP/1.1" 200 None
2026-03-28 07:42:14 [auto1.de] INFO: Scrape type for BK59777: 0
2026-03-28 07:42:14 [auto1.de] INFO: Found listing with ID: FB09525
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB09525%27 HTTP/1.1" 200 None
2026-03-28 07:42:14 [auto1.de] INFO: Scrape type for FB09525: 0
2026-03-28 07:42:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:15 [auto1.de] INFO: Channel: 24h | Page: 191 | totalHits: 9265 | hits on page: 40
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: NL50541
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL50541%27 HTTP/1.1" 200 None
2026-03-28 07:42:15 [auto1.de] INFO: Scrape type for NL50541: 0
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: AB87355
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB87355%27 HTTP/1.1" 200 None
2026-03-28 07:42:15 [auto1.de] INFO: Scrape type for AB87355: 0
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: RE53759
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: NX68666
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68666%27 HTTP/1.1" 200 None
2026-03-28 07:42:15 [auto1.de] INFO: Scrape type for NX68666: 0
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: JT97344
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT97344%27 HTTP/1.1" 200 None
2026-03-28 07:42:15 [auto1.de] INFO: Scrape type for JT97344: 0
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: ZW99084
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: RK12981
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: SM28331
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: PP43066
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: GE37655
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE37655%27 HTTP/1.1" 200 None
2026-03-28 07:42:15 [auto1.de] INFO: Scrape type for GE37655: 0
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: DJ93554
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: FF90181
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF90181%27 HTTP/1.1" 200 None
2026-03-28 07:42:15 [auto1.de] INFO: Scrape type for FF90181: 0
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: CZ73559
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: SP41921
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: KP48554
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: VX15127
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: RS38976
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS38976%27 HTTP/1.1" 200 None
2026-03-28 07:42:15 [auto1.de] INFO: Scrape type for RS38976: 0
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: XN16480
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: YT12990
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: ZE79625
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: ZU85888
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU85888%27 HTTP/1.1" 200 None
2026-03-28 07:42:15 [auto1.de] INFO: Scrape type for ZU85888: 0
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: VW35628
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW35628%27 HTTP/1.1" 200 None
2026-03-28 07:42:15 [auto1.de] INFO: Scrape type for VW35628: 0
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: DE80885
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: JX17185
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: BN48826
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN48826%27 HTTP/1.1" 200 None
2026-03-28 07:42:15 [auto1.de] INFO: Scrape type for BN48826: 0
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: LR18629
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR18629%27 HTTP/1.1" 200 None
2026-03-28 07:42:15 [auto1.de] INFO: Scrape type for LR18629: 0
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: XS57001
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: BB33034
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB33034%27 HTTP/1.1" 200 None
2026-03-28 07:42:15 [auto1.de] INFO: Scrape type for BB33034: 0
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: ZW26780
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW26780%27 HTTP/1.1" 200 None
2026-03-28 07:42:15 [auto1.de] INFO: Scrape type for ZW26780: 0
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: SW83321
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: PA36365
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA36365%27 HTTP/1.1" 200 None
2026-03-28 07:42:15 [auto1.de] INFO: Scrape type for PA36365: 0
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: MC36419
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: KC35382
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC35382%27 HTTP/1.1" 200 None
2026-03-28 07:42:15 [auto1.de] INFO: Scrape type for KC35382: 0
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: FZ80305
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: EX72807
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX72807%27 HTTP/1.1" 200 None
2026-03-28 07:42:15 [auto1.de] INFO: Scrape type for EX72807: 0
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: EG01443
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG01443%27 HTTP/1.1" 200 None
2026-03-28 07:42:15 [auto1.de] INFO: Scrape type for EG01443: 0
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: FR95379
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: VZ15565
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: KL31894
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL31894%27 HTTP/1.1" 200 None
2026-03-28 07:42:15 [auto1.de] INFO: Scrape type for KL31894: 0
2026-03-28 07:42:15 [auto1.de] INFO: Found listing with ID: PU37095
2026-03-28 07:42:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:24 [auto1.de] INFO: Channel: 24h | Page: 192 | totalHits: 9266 | hits on page: 40
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: PU37095
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: LF81800
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: BP33481
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: YY13521
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: RU59623
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: JK60563
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: ZU18943
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: VD47640
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD47640%27 HTTP/1.1" 200 None
2026-03-28 07:42:24 [auto1.de] INFO: Scrape type for VD47640: 0
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: DU13341
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13341%27 HTTP/1.1" 200 None
2026-03-28 07:42:24 [auto1.de] INFO: Scrape type for DU13341: 0
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: WC36574
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC36574%27 HTTP/1.1" 200 None
2026-03-28 07:42:24 [auto1.de] INFO: Scrape type for WC36574: 0
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: XB85584
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB85584%27 HTTP/1.1" 200 None
2026-03-28 07:42:24 [auto1.de] INFO: Scrape type for XB85584: 0
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: HB67521
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB67521%27 HTTP/1.1" 200 None
2026-03-28 07:42:24 [auto1.de] INFO: Scrape type for HB67521: 0
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: SE52893
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE52893%27 HTTP/1.1" 200 None
2026-03-28 07:42:24 [auto1.de] INFO: Scrape type for SE52893: 0
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: FS32666
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: ZN32695
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: SD86365
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD86365%27 HTTP/1.1" 200 None
2026-03-28 07:42:24 [auto1.de] INFO: Scrape type for SD86365: 0
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: MR34714
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: LF03511
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF03511%27 HTTP/1.1" 200 None
2026-03-28 07:42:24 [auto1.de] INFO: Scrape type for LF03511: 0
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: MK03700
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: FK77468
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: LW18163
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: PN22226
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN22226%27 HTTP/1.1" 200 None
2026-03-28 07:42:24 [auto1.de] INFO: Scrape type for PN22226: 0
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: AG44420
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG44420%27 HTTP/1.1" 200 None
2026-03-28 07:42:24 [auto1.de] INFO: Scrape type for AG44420: 0
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: MJ13308
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ13308%27 HTTP/1.1" 200 None
2026-03-28 07:42:24 [auto1.de] INFO: Scrape type for MJ13308: 0
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: WC63339
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63339%27 HTTP/1.1" 200 None
2026-03-28 07:42:24 [auto1.de] INFO: Scrape type for WC63339: 0
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: LL66179
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL66179%27 HTTP/1.1" 200 None
2026-03-28 07:42:24 [auto1.de] INFO: Scrape type for LL66179: 0
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: VP53971
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP53971%27 HTTP/1.1" 200 None
2026-03-28 07:42:24 [auto1.de] INFO: Scrape type for VP53971: 0
2026-03-28 07:42:24 [auto1.de] INFO: Found listing with ID: DE09566
2026-03-28 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE09566%27 HTTP/1.1" 200 None
2026-03-28 07:42:25 [auto1.de] INFO: Scrape type for DE09566: 0
2026-03-28 07:42:25 [auto1.de] INFO: Found listing with ID: BD50097
2026-03-28 07:42:25 [auto1.de] INFO: Found listing with ID: HM57840
2026-03-28 07:42:25 [auto1.de] INFO: Found listing with ID: FB90112
2026-03-28 07:42:25 [auto1.de] INFO: Found listing with ID: JW30909
2026-03-28 07:42:25 [auto1.de] INFO: Found listing with ID: NR35268
2026-03-28 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR35268%27 HTTP/1.1" 200 None
2026-03-28 07:42:25 [auto1.de] INFO: Scrape type for NR35268: 0
2026-03-28 07:42:25 [auto1.de] INFO: Found listing with ID: VE41412
2026-03-28 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41412%27 HTTP/1.1" 200 None
2026-03-28 07:42:25 [auto1.de] INFO: Scrape type for VE41412: 0
2026-03-28 07:42:25 [auto1.de] INFO: Found listing with ID: VV46432
2026-03-28 07:42:25 [auto1.de] INFO: Found listing with ID: KS78216
2026-03-28 07:42:25 [auto1.de] INFO: Found listing with ID: RC79950
2026-03-28 07:42:25 [auto1.de] INFO: Found listing with ID: UL59525
2026-03-28 07:42:25 [auto1.de] INFO: Found listing with ID: BX01003
2026-03-28 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX01003%27 HTTP/1.1" 200 None
2026-03-28 07:42:25 [auto1.de] INFO: Scrape type for BX01003: 0
2026-03-28 07:42:25 [auto1.de] INFO: Found listing with ID: HK20534
2026-03-28 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK20534%27 HTTP/1.1" 200 None
2026-03-28 07:42:25 [auto1.de] INFO: Scrape type for HK20534: 0
2026-03-28 07:42:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:26 [auto1.de] INFO: Channel: 24h | Page: 193 | totalHits: 9266 | hits on page: 40
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: UF20593
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF20593%27 HTTP/1.1" 200 None
2026-03-28 07:42:26 [auto1.de] INFO: Scrape type for UF20593: 0
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: CC81369
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC81369%27 HTTP/1.1" 200 None
2026-03-28 07:42:26 [auto1.de] INFO: Scrape type for CC81369: 0
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: UN23019
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN23019%27 HTTP/1.1" 200 None
2026-03-28 07:42:26 [auto1.de] INFO: Scrape type for UN23019: 0
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: EK21596
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK21596%27 HTTP/1.1" 200 None
2026-03-28 07:42:26 [auto1.de] INFO: Scrape type for EK21596: 0
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: AC15853
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: SD28198
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD28198%27 HTTP/1.1" 200 None
2026-03-28 07:42:26 [auto1.de] INFO: Scrape type for SD28198: 0
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: SP19687
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: NG44703
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG44703%27 HTTP/1.1" 200 None
2026-03-28 07:42:26 [auto1.de] INFO: Scrape type for NG44703: 0
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: LU27790
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: RG76834
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: HP18010
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP18010%27 HTTP/1.1" 200 None
2026-03-28 07:42:26 [auto1.de] INFO: Scrape type for HP18010: 0
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: UC42370
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: VC15219
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC15219%27 HTTP/1.1" 200 None
2026-03-28 07:42:26 [auto1.de] INFO: Scrape type for VC15219: 0
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: BN55276
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: GA58010
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA58010%27 HTTP/1.1" 200 None
2026-03-28 07:42:26 [auto1.de] INFO: Scrape type for GA58010: 0
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: SJ87943
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: DF59303
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF59303%27 HTTP/1.1" 200 None
2026-03-28 07:42:26 [auto1.de] INFO: Scrape type for DF59303: 0
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: EA40469
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: MA93398
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: TU49821
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU49821%27 HTTP/1.1" 200 None
2026-03-28 07:42:26 [auto1.de] INFO: Scrape type for TU49821: 0
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: CG74532
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG74532%27 HTTP/1.1" 200 None
2026-03-28 07:42:26 [auto1.de] INFO: Scrape type for CG74532: 0
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: DF30572
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF30572%27 HTTP/1.1" 200 None
2026-03-28 07:42:26 [auto1.de] INFO: Scrape type for DF30572: 0
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: CK07133
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK07133%27 HTTP/1.1" 200 None
2026-03-28 07:42:26 [auto1.de] INFO: Scrape type for CK07133: 0
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: TX89120
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: XH18940
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH18940%27 HTTP/1.1" 200 None
2026-03-28 07:42:26 [auto1.de] INFO: Scrape type for XH18940: 0
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: YS81106
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: AK08323
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: BE25239
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE25239%27 HTTP/1.1" 200 None
2026-03-28 07:42:26 [auto1.de] INFO: Scrape type for BE25239: 0
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: JN21638
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN21638%27 HTTP/1.1" 200 None
2026-03-28 07:42:26 [auto1.de] INFO: Scrape type for JN21638: 0
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: XY47977
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: HL08327
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL08327%27 HTTP/1.1" 200 None
2026-03-28 07:42:26 [auto1.de] INFO: Scrape type for HL08327: 0
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: PS35101
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: NC46979
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: SB81454
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: GE16553
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: PM23375
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM23375%27 HTTP/1.1" 200 None
2026-03-28 07:42:26 [auto1.de] INFO: Scrape type for PM23375: 0
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: UZ37067
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ37067%27 HTTP/1.1" 200 None
2026-03-28 07:42:26 [auto1.de] INFO: Scrape type for UZ37067: 0
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: WY87564
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY87564%27 HTTP/1.1" 200 None
2026-03-28 07:42:26 [auto1.de] INFO: Scrape type for WY87564: 0
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: SC06812
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC06812%27 HTTP/1.1" 200 None
2026-03-28 07:42:26 [auto1.de] INFO: Scrape type for SC06812: 0
2026-03-28 07:42:26 [auto1.de] INFO: Found listing with ID: YF78558
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF78558%27 HTTP/1.1" 200 None
2026-03-28 07:42:26 [auto1.de] INFO: Scrape type for YF78558: 0
2026-03-28 07:42:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:27 [auto1.de] INFO: Channel: 24h | Page: 194 | totalHits: 9266 | hits on page: 40
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: ZR01639
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: LA14502
2026-03-28 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA14502%27 HTTP/1.1" 200 None
2026-03-28 07:42:27 [auto1.de] INFO: Scrape type for LA14502: 0
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: GC05156
2026-03-28 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC05156%27 HTTP/1.1" 200 None
2026-03-28 07:42:27 [auto1.de] INFO: Scrape type for GC05156: 0
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: GT57416
2026-03-28 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT57416%27 HTTP/1.1" 200 None
2026-03-28 07:42:27 [auto1.de] INFO: Scrape type for GT57416: 0
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: ZP29614
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: XU86679
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: EX22671
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: UH40808
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: ZE17013
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: EJ47676
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: FR92717
2026-03-28 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR92717%27 HTTP/1.1" 200 None
2026-03-28 07:42:27 [auto1.de] INFO: Scrape type for FR92717: 0
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: TA25367
2026-03-28 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA25367%27 HTTP/1.1" 200 None
2026-03-28 07:42:27 [auto1.de] INFO: Scrape type for TA25367: 0
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: RN18911
2026-03-28 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN18911%27 HTTP/1.1" 200 None
2026-03-28 07:42:27 [auto1.de] INFO: Scrape type for RN18911: 0
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: DF38507
2026-03-28 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF38507%27 HTTP/1.1" 200 None
2026-03-28 07:42:27 [auto1.de] INFO: Scrape type for DF38507: 0
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: KE92828
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: SC10304
2026-03-28 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC10304%27 HTTP/1.1" 200 None
2026-03-28 07:42:27 [auto1.de] INFO: Scrape type for SC10304: 0
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: GM45973
2026-03-28 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM45973%27 HTTP/1.1" 200 None
2026-03-28 07:42:27 [auto1.de] INFO: Scrape type for GM45973: 0
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: YM57013
2026-03-28 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM57013%27 HTTP/1.1" 200 None
2026-03-28 07:42:27 [auto1.de] INFO: Scrape type for YM57013: 0
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: BR67018
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: EA75512
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: VF83806
2026-03-28 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF83806%27 HTTP/1.1" 200 None
2026-03-28 07:42:27 [auto1.de] INFO: Scrape type for VF83806: 0
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: SU14525
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: AR33954
2026-03-28 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR33954%27 HTTP/1.1" 200 None
2026-03-28 07:42:27 [auto1.de] INFO: Scrape type for AR33954: 0
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: XH92207
2026-03-28 07:42:27 [auto1.de] INFO: Found listing with ID: FL90187
2026-03-28 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL90187%27 HTTP/1.1" 200 None
2026-03-28 07:42:28 [auto1.de] INFO: Scrape type for FL90187: 0
2026-03-28 07:42:28 [auto1.de] INFO: Found listing with ID: WB38942
2026-03-28 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB38942%27 HTTP/1.1" 200 None
2026-03-28 07:42:28 [auto1.de] INFO: Scrape type for WB38942: 0
2026-03-28 07:42:28 [auto1.de] INFO: Found listing with ID: XT08525
2026-03-28 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT08525%27 HTTP/1.1" 200 None
2026-03-28 07:42:28 [auto1.de] INFO: Scrape type for XT08525: 0
2026-03-28 07:42:28 [auto1.de] INFO: Found listing with ID: EX64550
2026-03-28 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX64550%27 HTTP/1.1" 200 None
2026-03-28 07:42:28 [auto1.de] INFO: Scrape type for EX64550: 0
2026-03-28 07:42:28 [auto1.de] INFO: Found listing with ID: FZ93202
2026-03-28 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ93202%27 HTTP/1.1" 200 None
2026-03-28 07:42:28 [auto1.de] INFO: Scrape type for FZ93202: 0
2026-03-28 07:42:28 [auto1.de] INFO: Found listing with ID: BD51611
2026-03-28 07:42:28 [auto1.de] INFO: Found listing with ID: TT34897
2026-03-28 07:42:28 [auto1.de] INFO: Found listing with ID: ML20845
2026-03-28 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML20845%27 HTTP/1.1" 200 None
2026-03-28 07:42:28 [auto1.de] INFO: Scrape type for ML20845: 0
2026-03-28 07:42:28 [auto1.de] INFO: Found listing with ID: BN78852
2026-03-28 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN78852%27 HTTP/1.1" 200 None
2026-03-28 07:42:28 [auto1.de] INFO: Scrape type for BN78852: 0
2026-03-28 07:42:28 [auto1.de] INFO: Found listing with ID: ZT20326
2026-03-28 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT20326%27 HTTP/1.1" 200 None
2026-03-28 07:42:28 [auto1.de] INFO: Scrape type for ZT20326: 0
2026-03-28 07:42:28 [auto1.de] INFO: Found listing with ID: VG97349
2026-03-28 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG97349%27 HTTP/1.1" 200 None
2026-03-28 07:42:28 [auto1.de] INFO: Scrape type for VG97349: 0
2026-03-28 07:42:28 [auto1.de] INFO: Found listing with ID: BK65604
2026-03-28 07:42:28 [auto1.de] INFO: Found listing with ID: EP70088
2026-03-28 07:42:28 [auto1.de] INFO: Found listing with ID: WS02654
2026-03-28 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02654%27 HTTP/1.1" 200 None
2026-03-28 07:42:28 [auto1.de] INFO: Scrape type for WS02654: 0
2026-03-28 07:42:28 [auto1.de] INFO: Found listing with ID: VB62953
2026-03-28 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB62953%27 HTTP/1.1" 200 None
2026-03-28 07:42:28 [auto1.de] INFO: Scrape type for VB62953: 0
2026-03-28 07:42:28 [auto1.de] INFO: Found listing with ID: LE21956
2026-03-28 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE21956%27 HTTP/1.1" 200 None
2026-03-28 07:42:28 [auto1.de] INFO: Scrape type for LE21956: 0
2026-03-28 07:42:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:29 [auto1.de] INFO: Channel: 24h | Page: 195 | totalHits: 9266 | hits on page: 40
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: XH60803
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: KH20562
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: KH96137
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: EY23363
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY23363%27 HTTP/1.1" 200 None
2026-03-28 07:42:29 [auto1.de] INFO: Scrape type for EY23363: 0
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: MU47356
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU47356%27 HTTP/1.1" 200 None
2026-03-28 07:42:29 [auto1.de] INFO: Scrape type for MU47356: 0
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: FL14438
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL14438%27 HTTP/1.1" 200 None
2026-03-28 07:42:29 [auto1.de] INFO: Scrape type for FL14438: 0
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: HA69467
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA69467%27 HTTP/1.1" 200 None
2026-03-28 07:42:29 [auto1.de] INFO: Scrape type for HA69467: 0
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: PY44699
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY44699%27 HTTP/1.1" 200 None
2026-03-28 07:42:29 [auto1.de] INFO: Scrape type for PY44699: 0
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: CJ94642
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: SD45668
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: FX08537
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: CE85756
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: SF33056
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: ZV33449
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV33449%27 HTTP/1.1" 200 None
2026-03-28 07:42:29 [auto1.de] INFO: Scrape type for ZV33449: 0
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: SA55190
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA55190%27 HTTP/1.1" 200 None
2026-03-28 07:42:29 [auto1.de] INFO: Scrape type for SA55190: 0
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: BG81908
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: BG14243
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: JK17459
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK17459%27 HTTP/1.1" 200 None
2026-03-28 07:42:29 [auto1.de] INFO: Scrape type for JK17459: 0
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: HG45518
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG45518%27 HTTP/1.1" 200 None
2026-03-28 07:42:29 [auto1.de] INFO: Scrape type for HG45518: 0
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: KR60146
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR60146%27 HTTP/1.1" 200 None
2026-03-28 07:42:29 [auto1.de] INFO: Scrape type for KR60146: 0
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: DF93652
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: HV25811
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: CA31330
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA31330%27 HTTP/1.1" 200 None
2026-03-28 07:42:29 [auto1.de] INFO: Scrape type for CA31330: 0
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: SX60280
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX60280%27 HTTP/1.1" 200 None
2026-03-28 07:42:29 [auto1.de] INFO: Scrape type for SX60280: 0
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: XT97786
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: UU73518
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU73518%27 HTTP/1.1" 200 None
2026-03-28 07:42:29 [auto1.de] INFO: Scrape type for UU73518: 0
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: UM95943
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM95943%27 HTTP/1.1" 200 None
2026-03-28 07:42:29 [auto1.de] INFO: Scrape type for UM95943: 0
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: HJ94843
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ94843%27 HTTP/1.1" 200 None
2026-03-28 07:42:29 [auto1.de] INFO: Scrape type for HJ94843: 0
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: NW54336
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: PS82435
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: HD83134
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: PF67152
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF67152%27 HTTP/1.1" 200 None
2026-03-28 07:42:29 [auto1.de] INFO: Scrape type for PF67152: 0
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: BK83629
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: JK31212
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK31212%27 HTTP/1.1" 200 None
2026-03-28 07:42:29 [auto1.de] INFO: Scrape type for JK31212: 0
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: EL68687
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: ZS15843
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: XR58128
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR58128%27 HTTP/1.1" 200 None
2026-03-28 07:42:29 [auto1.de] INFO: Scrape type for XR58128: 0
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: XE19125
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: ZU59417
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU59417%27 HTTP/1.1" 200 None
2026-03-28 07:42:29 [auto1.de] INFO: Scrape type for ZU59417: 0
2026-03-28 07:42:29 [auto1.de] INFO: Found listing with ID: DG34410
2026-03-28 07:42:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:32 [auto1.de] INFO: Channel: 24h | Page: 196 | totalHits: 9266 | hits on page: 40
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: LX86336
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX86336%27 HTTP/1.1" 200 None
2026-03-28 07:42:32 [auto1.de] INFO: Scrape type for LX86336: 0
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: HK68029
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK68029%27 HTTP/1.1" 200 None
2026-03-28 07:42:32 [auto1.de] INFO: Scrape type for HK68029: 0
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: CY33039
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: YJ51408
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: GY96570
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY96570%27 HTTP/1.1" 200 None
2026-03-28 07:42:32 [auto1.de] INFO: Scrape type for GY96570: 0
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: EG34201
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG34201%27 HTTP/1.1" 200 None
2026-03-28 07:42:32 [auto1.de] INFO: Scrape type for EG34201: 0
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: AG88480
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: AL71232
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL71232%27 HTTP/1.1" 200 None
2026-03-28 07:42:32 [auto1.de] INFO: Scrape type for AL71232: 0
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: PH16330
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH16330%27 HTTP/1.1" 200 None
2026-03-28 07:42:32 [auto1.de] INFO: Scrape type for PH16330: 0
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: XU55815
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: PB28144
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: BJ03907
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ03907%27 HTTP/1.1" 200 None
2026-03-28 07:42:32 [auto1.de] INFO: Scrape type for BJ03907: 0
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: HH61225
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH61225%27 HTTP/1.1" 200 None
2026-03-28 07:42:32 [auto1.de] INFO: Scrape type for HH61225: 0
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: RJ10234
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: CC89371
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89371%27 HTTP/1.1" 200 None
2026-03-28 07:42:32 [auto1.de] INFO: Scrape type for CC89371: 0
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: VG26326
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG26326%27 HTTP/1.1" 200 None
2026-03-28 07:42:32 [auto1.de] INFO: Scrape type for VG26326: 0
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: LL88784
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL88784%27 HTTP/1.1" 200 None
2026-03-28 07:42:32 [auto1.de] INFO: Scrape type for LL88784: 0
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: HW66490
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW66490%27 HTTP/1.1" 200 None
2026-03-28 07:42:32 [auto1.de] INFO: Scrape type for HW66490: 0
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: UH98886
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: XC17243
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC17243%27 HTTP/1.1" 200 None
2026-03-28 07:42:32 [auto1.de] INFO: Scrape type for XC17243: 0
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: HZ19691
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ19691%27 HTTP/1.1" 200 None
2026-03-28 07:42:32 [auto1.de] INFO: Scrape type for HZ19691: 0
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: NV75211
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: PZ27483
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ27483%27 HTTP/1.1" 200 None
2026-03-28 07:42:32 [auto1.de] INFO: Scrape type for PZ27483: 0
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: HX66232
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: CS56497
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: AM15816
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: RJ47669
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: ZK39912
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK39912%27 HTTP/1.1" 200 None
2026-03-28 07:42:32 [auto1.de] INFO: Scrape type for ZK39912: 0
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: JU74172
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: MZ82429
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: GA31373
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: YH04834
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: FL12267
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: WN12652
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: DW51780
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: DD89889
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD89889%27 HTTP/1.1" 200 None
2026-03-28 07:42:32 [auto1.de] INFO: Scrape type for DD89889: 0
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: TK47054
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK47054%27 HTTP/1.1" 200 None
2026-03-28 07:42:32 [auto1.de] INFO: Scrape type for TK47054: 0
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: TL66452
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: WB03477
2026-03-28 07:42:32 [auto1.de] INFO: Found listing with ID: LJ75768
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ75768%27 HTTP/1.1" 200 None
2026-03-28 07:42:32 [auto1.de] INFO: Scrape type for LJ75768: 0
2026-03-28 07:42:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:33 [auto1.de] INFO: Channel: 24h | Page: 197 | totalHits: 9266 | hits on page: 40
2026-03-28 07:42:33 [auto1.de] INFO: Found listing with ID: FY30353
2026-03-28 07:42:33 [auto1.de] INFO: Found listing with ID: GL59385
2026-03-28 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL59385%27 HTTP/1.1" 200 None
2026-03-28 07:42:33 [auto1.de] INFO: Scrape type for GL59385: 0
2026-03-28 07:42:33 [auto1.de] INFO: Found listing with ID: DE77804
2026-03-28 07:42:33 [auto1.de] INFO: Found listing with ID: PZ82865
2026-03-28 07:42:33 [auto1.de] INFO: Found listing with ID: WF80406
2026-03-28 07:42:33 [auto1.de] INFO: Found listing with ID: FF62684
2026-03-28 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF62684%27 HTTP/1.1" 200 None
2026-03-28 07:42:33 [auto1.de] INFO: Scrape type for FF62684: 0
2026-03-28 07:42:33 [auto1.de] INFO: Found listing with ID: NS47503
2026-03-28 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS47503%27 HTTP/1.1" 200 None
2026-03-28 07:42:34 [auto1.de] INFO: Scrape type for NS47503: 0
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: TX48260
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX48260%27 HTTP/1.1" 200 None
2026-03-28 07:42:34 [auto1.de] INFO: Scrape type for TX48260: 0
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: MV18053
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: SY34106
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: JR98479
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: KU06936
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU06936%27 HTTP/1.1" 200 None
2026-03-28 07:42:34 [auto1.de] INFO: Scrape type for KU06936: 0
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: KJ86247
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: KM87247
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM87247%27 HTTP/1.1" 200 None
2026-03-28 07:42:34 [auto1.de] INFO: Scrape type for KM87247: 0
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: YK98725
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: PS47170
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS47170%27 HTTP/1.1" 200 None
2026-03-28 07:42:34 [auto1.de] INFO: Scrape type for PS47170: 0
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: NN29334
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN29334%27 HTTP/1.1" 200 None
2026-03-28 07:42:34 [auto1.de] INFO: Scrape type for NN29334: 0
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: DF96715
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: EV39961
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV39961%27 HTTP/1.1" 200 None
2026-03-28 07:42:34 [auto1.de] INFO: Scrape type for EV39961: 0
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: CU86908
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: WY91699
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY91699%27 HTTP/1.1" 200 None
2026-03-28 07:42:34 [auto1.de] INFO: Scrape type for WY91699: 0
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: DM70862
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: SR51449
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR51449%27 HTTP/1.1" 200 None
2026-03-28 07:42:34 [auto1.de] INFO: Scrape type for SR51449: 0
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: RU29030
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: DT77440
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT77440%27 HTTP/1.1" 200 None
2026-03-28 07:42:34 [auto1.de] INFO: Scrape type for DT77440: 0
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: MD24708
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: KW79987
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW79987%27 HTTP/1.1" 200 None
2026-03-28 07:42:34 [auto1.de] INFO: Scrape type for KW79987: 0
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: YU96411
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU96411%27 HTTP/1.1" 200 None
2026-03-28 07:42:34 [auto1.de] INFO: Scrape type for YU96411: 0
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: YF55621
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: AD28287
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD28287%27 HTTP/1.1" 200 None
2026-03-28 07:42:34 [auto1.de] INFO: Scrape type for AD28287: 0
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: ZZ43768
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: SB04104
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: HJ11294
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ11294%27 HTTP/1.1" 200 None
2026-03-28 07:42:34 [auto1.de] INFO: Scrape type for HJ11294: 0
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: MJ60689
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: RJ71204
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: LU16486
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU16486%27 HTTP/1.1" 200 None
2026-03-28 07:42:34 [auto1.de] INFO: Scrape type for LU16486: 0
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: UF88550
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: RU03073
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU03073%27 HTTP/1.1" 200 None
2026-03-28 07:42:34 [auto1.de] INFO: Scrape type for RU03073: 0
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: JX81073
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX81073%27 HTTP/1.1" 200 None
2026-03-28 07:42:34 [auto1.de] INFO: Scrape type for JX81073: 0
2026-03-28 07:42:34 [auto1.de] INFO: Found listing with ID: FN85650
2026-03-28 07:42:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:35 [auto1.de] INFO: Channel: 24h | Page: 198 | totalHits: 9266 | hits on page: 40
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: GD60404
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD60404%27 HTTP/1.1" 200 None
2026-03-28 07:42:35 [auto1.de] INFO: Scrape type for GD60404: 0
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: BF57036
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF57036%27 HTTP/1.1" 200 None
2026-03-28 07:42:35 [auto1.de] INFO: Scrape type for BF57036: 0
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: VC80296
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: UH99848
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH99848%27 HTTP/1.1" 200 None
2026-03-28 07:42:35 [auto1.de] INFO: Scrape type for UH99848: 0
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: XF55006
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF55006%27 HTTP/1.1" 200 None
2026-03-28 07:42:35 [auto1.de] INFO: Scrape type for XF55006: 0
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: CR52623
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: BK49064
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: MY70814
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY70814%27 HTTP/1.1" 200 None
2026-03-28 07:42:35 [auto1.de] INFO: Scrape type for MY70814: 0
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: HG64056
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG64056%27 HTTP/1.1" 200 None
2026-03-28 07:42:35 [auto1.de] INFO: Scrape type for HG64056: 0
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: WK78247
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: PK39186
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK39186%27 HTTP/1.1" 200 None
2026-03-28 07:42:35 [auto1.de] INFO: Scrape type for PK39186: 0
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: ZC13254
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: TE33138
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: FB58638
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: SA94096
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: LR76257
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR76257%27 HTTP/1.1" 200 None
2026-03-28 07:42:35 [auto1.de] INFO: Scrape type for LR76257: 0
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: ND38532
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: YE81869
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE81869%27 HTTP/1.1" 200 None
2026-03-28 07:42:35 [auto1.de] INFO: Scrape type for YE81869: 0
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: BK53036
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: PU73268
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: GX10720
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: PF97511
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF97511%27 HTTP/1.1" 200 None
2026-03-28 07:42:35 [auto1.de] INFO: Scrape type for PF97511: 0
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: HX00306
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX00306%27 HTTP/1.1" 200 None
2026-03-28 07:42:35 [auto1.de] INFO: Scrape type for HX00306: 0
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: DT83749
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: UH00039
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: SA71883
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: XG94093
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG94093%27 HTTP/1.1" 200 None
2026-03-28 07:42:35 [auto1.de] INFO: Scrape type for XG94093: 0
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: XK87583
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK87583%27 HTTP/1.1" 200 None
2026-03-28 07:42:35 [auto1.de] INFO: Scrape type for XK87583: 0
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: PU26229
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU26229%27 HTTP/1.1" 200 None
2026-03-28 07:42:35 [auto1.de] INFO: Scrape type for PU26229: 0
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: YP68247
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: HY47852
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: VX14818
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14818%27 HTTP/1.1" 200 None
2026-03-28 07:42:35 [auto1.de] INFO: Scrape type for VX14818: 0
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: LM98964
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM98964%27 HTTP/1.1" 200 None
2026-03-28 07:42:35 [auto1.de] INFO: Scrape type for LM98964: 0
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: ZR39643
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39643%27 HTTP/1.1" 200 None
2026-03-28 07:42:35 [auto1.de] INFO: Scrape type for ZR39643: 0
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: LS36397
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS36397%27 HTTP/1.1" 200 None
2026-03-28 07:42:35 [auto1.de] INFO: Scrape type for LS36397: 0
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: AP27918
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: DD70281
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD70281%27 HTTP/1.1" 200 None
2026-03-28 07:42:35 [auto1.de] INFO: Scrape type for DD70281: 0
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: UD88757
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: JC63536
2026-03-28 07:42:35 [auto1.de] INFO: Found listing with ID: CM33145
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM33145%27 HTTP/1.1" 200 None
2026-03-28 07:42:35 [auto1.de] INFO: Scrape type for CM33145: 0
2026-03-28 07:42:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:36 [auto1.de] INFO: Channel: 24h | Page: 199 | totalHits: 9266 | hits on page: 40
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: KR04535
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR04535%27 HTTP/1.1" 200 None
2026-03-28 07:42:36 [auto1.de] INFO: Scrape type for KR04535: 0
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: CR82363
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: PE91450
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE91450%27 HTTP/1.1" 200 None
2026-03-28 07:42:36 [auto1.de] INFO: Scrape type for PE91450: 0
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: KE42269
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: BA02242
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: AW26352
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: ZP61360
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: BV55429
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV55429%27 HTTP/1.1" 200 None
2026-03-28 07:42:36 [auto1.de] INFO: Scrape type for BV55429: 0
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: HT48359
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT48359%27 HTTP/1.1" 200 None
2026-03-28 07:42:36 [auto1.de] INFO: Scrape type for HT48359: 0
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: YM40569
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: TF25150
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF25150%27 HTTP/1.1" 200 None
2026-03-28 07:42:36 [auto1.de] INFO: Scrape type for TF25150: 0
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: AE71125
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: HS66521
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS66521%27 HTTP/1.1" 200 None
2026-03-28 07:42:36 [auto1.de] INFO: Scrape type for HS66521: 0
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: TL23560
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: YR07443
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR07443%27 HTTP/1.1" 200 None
2026-03-28 07:42:36 [auto1.de] INFO: Scrape type for YR07443: 0
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: DG19497
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: EJ40099
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ40099%27 HTTP/1.1" 200 None
2026-03-28 07:42:36 [auto1.de] INFO: Scrape type for EJ40099: 0
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: KS23837
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS23837%27 HTTP/1.1" 200 None
2026-03-28 07:42:36 [auto1.de] INFO: Scrape type for KS23837: 0
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: NY67891
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY67891%27 HTTP/1.1" 200 None
2026-03-28 07:42:36 [auto1.de] INFO: Scrape type for NY67891: 0
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: UX48590
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: FY25163
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY25163%27 HTTP/1.1" 200 None
2026-03-28 07:42:36 [auto1.de] INFO: Scrape type for FY25163: 0
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: UJ12211
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: GT07597
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: WD77905
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD77905%27 HTTP/1.1" 200 None
2026-03-28 07:42:36 [auto1.de] INFO: Scrape type for WD77905: 0
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: CY56514
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY56514%27 HTTP/1.1" 200 None
2026-03-28 07:42:36 [auto1.de] INFO: Scrape type for CY56514: 0
2026-03-28 07:42:36 [auto1.de] INFO: Found listing with ID: ZY38898
2026-03-28 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY38898%27 HTTP/1.1" 200 None
2026-03-28 07:42:37 [auto1.de] INFO: Scrape type for ZY38898: 0
2026-03-28 07:42:37 [auto1.de] INFO: Found listing with ID: US02416
2026-03-28 07:42:37 [auto1.de] INFO: Found listing with ID: NX41680
2026-03-28 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX41680%27 HTTP/1.1" 200 None
2026-03-28 07:42:37 [auto1.de] INFO: Scrape type for NX41680: 0
2026-03-28 07:42:37 [auto1.de] INFO: Found listing with ID: AH37368
2026-03-28 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH37368%27 HTTP/1.1" 200 None
2026-03-28 07:42:37 [auto1.de] INFO: Scrape type for AH37368: 0
2026-03-28 07:42:37 [auto1.de] INFO: Found listing with ID: CV35791
2026-03-28 07:42:37 [auto1.de] INFO: Found listing with ID: BF26414
2026-03-28 07:42:37 [auto1.de] INFO: Found listing with ID: GM59511
2026-03-28 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59511%27 HTTP/1.1" 200 None
2026-03-28 07:42:37 [auto1.de] INFO: Scrape type for GM59511: 0
2026-03-28 07:42:37 [auto1.de] INFO: Found listing with ID: HF47887
2026-03-28 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF47887%27 HTTP/1.1" 200 None
2026-03-28 07:42:37 [auto1.de] INFO: Scrape type for HF47887: 0
2026-03-28 07:42:37 [auto1.de] INFO: Found listing with ID: WP35313
2026-03-28 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP35313%27 HTTP/1.1" 200 None
2026-03-28 07:42:37 [auto1.de] INFO: Scrape type for WP35313: 0
2026-03-28 07:42:37 [auto1.de] INFO: Found listing with ID: AU29418
2026-03-28 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU29418%27 HTTP/1.1" 200 None
2026-03-28 07:42:37 [auto1.de] INFO: Scrape type for AU29418: 0
2026-03-28 07:42:37 [auto1.de] INFO: Found listing with ID: BR24647
2026-03-28 07:42:37 [auto1.de] INFO: Found listing with ID: CV64840
2026-03-28 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV64840%27 HTTP/1.1" 200 None
2026-03-28 07:42:37 [auto1.de] INFO: Scrape type for CV64840: 0
2026-03-28 07:42:37 [auto1.de] INFO: Found listing with ID: RX49945
2026-03-28 07:42:37 [auto1.de] INFO: Found listing with ID: WX13584
2026-03-28 07:42:37 [auto1.de] INFO: Found listing with ID: MV92547
2026-03-28 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92547%27 HTTP/1.1" 200 None
2026-03-28 07:42:37 [auto1.de] INFO: Scrape type for MV92547: 0
2026-03-28 07:42:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:38 [auto1.de] INFO: Channel: 24h | Page: 200 | totalHits: 9266 | hits on page: 40
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: NK53054
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: JM73266
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: ND18169
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND18169%27 HTTP/1.1" 200 None
2026-03-28 07:42:38 [auto1.de] INFO: Scrape type for ND18169: 0
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: UE28952
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE28952%27 HTTP/1.1" 200 None
2026-03-28 07:42:38 [auto1.de] INFO: Scrape type for UE28952: 0
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: KM67977
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: RZ86023
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ86023%27 HTTP/1.1" 200 None
2026-03-28 07:42:38 [auto1.de] INFO: Scrape type for RZ86023: 0
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: ML83071
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML83071%27 HTTP/1.1" 200 None
2026-03-28 07:42:38 [auto1.de] INFO: Scrape type for ML83071: 0
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: JV63052
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: DF17432
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF17432%27 HTTP/1.1" 200 None
2026-03-28 07:42:38 [auto1.de] INFO: Scrape type for DF17432: 0
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: NB05774
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB05774%27 HTTP/1.1" 200 None
2026-03-28 07:42:38 [auto1.de] INFO: Scrape type for NB05774: 0
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: JS62021
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS62021%27 HTTP/1.1" 200 None
2026-03-28 07:42:38 [auto1.de] INFO: Scrape type for JS62021: 0
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: CZ66164
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: FD55088
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD55088%27 HTTP/1.1" 200 None
2026-03-28 07:42:38 [auto1.de] INFO: Scrape type for FD55088: 0
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: YN10477
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN10477%27 HTTP/1.1" 200 None
2026-03-28 07:42:38 [auto1.de] INFO: Scrape type for YN10477: 0
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: BS14183
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS14183%27 HTTP/1.1" 200 None
2026-03-28 07:42:38 [auto1.de] INFO: Scrape type for BS14183: 0
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: JH37191
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: KJ55573
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ55573%27 HTTP/1.1" 200 None
2026-03-28 07:42:38 [auto1.de] INFO: Scrape type for KJ55573: 0
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: UN13511
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN13511%27 HTTP/1.1" 200 None
2026-03-28 07:42:38 [auto1.de] INFO: Scrape type for UN13511: 0
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: TJ39363
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: UV04147
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: SC19815
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: KN66940
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: BC36387
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: SF39323
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF39323%27 HTTP/1.1" 200 None
2026-03-28 07:42:38 [auto1.de] INFO: Scrape type for SF39323: 0
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: AZ50044
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: JV68921
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68921%27 HTTP/1.1" 200 None
2026-03-28 07:42:38 [auto1.de] INFO: Scrape type for JV68921: 0
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: UH90150
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: TU97792
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU97792%27 HTTP/1.1" 200 None
2026-03-28 07:42:38 [auto1.de] INFO: Scrape type for TU97792: 0
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: VG31593
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG31593%27 HTTP/1.1" 200 None
2026-03-28 07:42:38 [auto1.de] INFO: Scrape type for VG31593: 0
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: XS31792
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: YH72749
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: DS71504
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS71504%27 HTTP/1.1" 200 None
2026-03-28 07:42:38 [auto1.de] INFO: Scrape type for DS71504: 0
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: FK36654
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: KP12697
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: BS83474
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: WC52225
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: XX81034
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: BP39163
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: ZE41577
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE41577%27 HTTP/1.1" 200 None
2026-03-28 07:42:38 [auto1.de] INFO: Scrape type for ZE41577: 0
2026-03-28 07:42:38 [auto1.de] INFO: Found listing with ID: EL79145
2026-03-28 07:42:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:39 [auto1.de] INFO: Channel: 24h | Page: 201 | totalHits: 9266 | hits on page: 40
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: DM09688
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM09688%27 HTTP/1.1" 200 None
2026-03-28 07:42:39 [auto1.de] INFO: Scrape type for DM09688: 0
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: EJ65167
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ65167%27 HTTP/1.1" 200 None
2026-03-28 07:42:39 [auto1.de] INFO: Scrape type for EJ65167: 0
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: LK89545
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: FC63717
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC63717%27 HTTP/1.1" 200 None
2026-03-28 07:42:39 [auto1.de] INFO: Scrape type for FC63717: 0
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: EN50331
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN50331%27 HTTP/1.1" 200 None
2026-03-28 07:42:39 [auto1.de] INFO: Scrape type for EN50331: 0
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: JA64656
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: GT54447
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT54447%27 HTTP/1.1" 200 None
2026-03-28 07:42:39 [auto1.de] INFO: Scrape type for GT54447: 0
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: UC48235
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC48235%27 HTTP/1.1" 200 None
2026-03-28 07:42:39 [auto1.de] INFO: Scrape type for UC48235: 0
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: SJ09412
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: PZ64082
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: DL95499
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: PD80009
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD80009%27 HTTP/1.1" 200 None
2026-03-28 07:42:39 [auto1.de] INFO: Scrape type for PD80009: 0
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: PZ11168
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ11168%27 HTTP/1.1" 200 None
2026-03-28 07:42:39 [auto1.de] INFO: Scrape type for PZ11168: 0
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: LB22457
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB22457%27 HTTP/1.1" 200 None
2026-03-28 07:42:39 [auto1.de] INFO: Scrape type for LB22457: 0
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: TW84588
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW84588%27 HTTP/1.1" 200 None
2026-03-28 07:42:39 [auto1.de] INFO: Scrape type for TW84588: 0
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: ZY13516
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: VM43459
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: RR18814
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR18814%27 HTTP/1.1" 200 None
2026-03-28 07:42:39 [auto1.de] INFO: Scrape type for RR18814: 0
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: VY28868
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: EE19276
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE19276%27 HTTP/1.1" 200 None
2026-03-28 07:42:39 [auto1.de] INFO: Scrape type for EE19276: 0
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: FS96919
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: NR67134
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR67134%27 HTTP/1.1" 200 None
2026-03-28 07:42:39 [auto1.de] INFO: Scrape type for NR67134: 0
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: UJ33462
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ33462%27 HTTP/1.1" 200 None
2026-03-28 07:42:39 [auto1.de] INFO: Scrape type for UJ33462: 0
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: TC26510
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC26510%27 HTTP/1.1" 200 None
2026-03-28 07:42:39 [auto1.de] INFO: Scrape type for TC26510: 0
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: MT56584
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: YA68492
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA68492%27 HTTP/1.1" 200 None
2026-03-28 07:42:39 [auto1.de] INFO: Scrape type for YA68492: 0
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: BD72910
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD72910%27 HTTP/1.1" 200 None
2026-03-28 07:42:39 [auto1.de] INFO: Scrape type for BD72910: 0
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: LB25198
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: NA53807
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA53807%27 HTTP/1.1" 200 None
2026-03-28 07:42:39 [auto1.de] INFO: Scrape type for NA53807: 0
2026-03-28 07:42:39 [auto1.de] INFO: Found listing with ID: MZ26894
2026-03-28 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ26894%27 HTTP/1.1" 200 None
2026-03-28 07:42:40 [auto1.de] INFO: Scrape type for MZ26894: 0
2026-03-28 07:42:40 [auto1.de] INFO: Found listing with ID: FP92588
2026-03-28 07:42:40 [auto1.de] INFO: Found listing with ID: HV11819
2026-03-28 07:42:40 [auto1.de] INFO: Found listing with ID: UX10113
2026-03-28 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX10113%27 HTTP/1.1" 200 None
2026-03-28 07:42:40 [auto1.de] INFO: Scrape type for UX10113: 0
2026-03-28 07:42:40 [auto1.de] INFO: Found listing with ID: NE66332
2026-03-28 07:42:40 [auto1.de] INFO: Found listing with ID: YJ99770
2026-03-28 07:42:40 [auto1.de] INFO: Found listing with ID: RJ15430
2026-03-28 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ15430%27 HTTP/1.1" 200 None
2026-03-28 07:42:40 [auto1.de] INFO: Scrape type for RJ15430: 0
2026-03-28 07:42:40 [auto1.de] INFO: Found listing with ID: XB16241
2026-03-28 07:42:40 [auto1.de] INFO: Found listing with ID: FU30780
2026-03-28 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU30780%27 HTTP/1.1" 200 None
2026-03-28 07:42:40 [auto1.de] INFO: Scrape type for FU30780: 0
2026-03-28 07:42:40 [auto1.de] INFO: Found listing with ID: BD12559
2026-03-28 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD12559%27 HTTP/1.1" 200 None
2026-03-28 07:42:40 [auto1.de] INFO: Scrape type for BD12559: 0
2026-03-28 07:42:40 [auto1.de] INFO: Found listing with ID: EP05122
2026-03-28 07:42:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:41 [auto1.de] INFO: Channel: 24h | Page: 202 | totalHits: 9266 | hits on page: 40
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: DB46013
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB46013%27 HTTP/1.1" 200 None
2026-03-28 07:42:41 [auto1.de] INFO: Scrape type for DB46013: 0
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: MA81482
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: RF33157
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF33157%27 HTTP/1.1" 200 None
2026-03-28 07:42:41 [auto1.de] INFO: Scrape type for RF33157: 0
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: TJ83975
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: HE81981
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE81981%27 HTTP/1.1" 200 None
2026-03-28 07:42:41 [auto1.de] INFO: Scrape type for HE81981: 0
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: NN62521
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: AB49272
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB49272%27 HTTP/1.1" 200 None
2026-03-28 07:42:41 [auto1.de] INFO: Scrape type for AB49272: 0
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: ZN02812
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN02812%27 HTTP/1.1" 200 None
2026-03-28 07:42:41 [auto1.de] INFO: Scrape type for ZN02812: 0
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: CW50467
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: BW18754
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW18754%27 HTTP/1.1" 200 None
2026-03-28 07:42:41 [auto1.de] INFO: Scrape type for BW18754: 0
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: MF02392
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF02392%27 HTTP/1.1" 200 None
2026-03-28 07:42:41 [auto1.de] INFO: Scrape type for MF02392: 0
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: BN30919
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN30919%27 HTTP/1.1" 200 None
2026-03-28 07:42:41 [auto1.de] INFO: Scrape type for BN30919: 0
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: KH74255
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: SG28437
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28437%27 HTTP/1.1" 200 None
2026-03-28 07:42:41 [auto1.de] INFO: Scrape type for SG28437: 0
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: KA22944
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: DE69910
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE69910%27 HTTP/1.1" 200 None
2026-03-28 07:42:41 [auto1.de] INFO: Scrape type for DE69910: 0
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: SX47208
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX47208%27 HTTP/1.1" 200 None
2026-03-28 07:42:41 [auto1.de] INFO: Scrape type for SX47208: 0
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: UN34708
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN34708%27 HTTP/1.1" 200 None
2026-03-28 07:42:41 [auto1.de] INFO: Scrape type for UN34708: 0
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: YA26169
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: JB86141
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB86141%27 HTTP/1.1" 200 None
2026-03-28 07:42:41 [auto1.de] INFO: Scrape type for JB86141: 0
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: MX79326
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: GG89012
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG89012%27 HTTP/1.1" 200 None
2026-03-28 07:42:41 [auto1.de] INFO: Scrape type for GG89012: 0
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: LG78390
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG78390%27 HTTP/1.1" 200 None
2026-03-28 07:42:41 [auto1.de] INFO: Scrape type for LG78390: 0
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: XT91998
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: PL64975
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: BX10295
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX10295%27 HTTP/1.1" 200 None
2026-03-28 07:42:41 [auto1.de] INFO: Scrape type for BX10295: 0
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: EF82631
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF82631%27 HTTP/1.1" 200 None
2026-03-28 07:42:41 [auto1.de] INFO: Scrape type for EF82631: 0
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: GK82878
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: CG37659
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: HU16718
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU16718%27 HTTP/1.1" 200 None
2026-03-28 07:42:41 [auto1.de] INFO: Scrape type for HU16718: 0
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: HA99169
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA99169%27 HTTP/1.1" 200 None
2026-03-28 07:42:41 [auto1.de] INFO: Scrape type for HA99169: 0
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: GV33356
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: EY45109
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: VY38504
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY38504%27 HTTP/1.1" 200 None
2026-03-28 07:42:41 [auto1.de] INFO: Scrape type for VY38504: 0
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: ZV87570
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV87570%27 HTTP/1.1" 200 None
2026-03-28 07:42:41 [auto1.de] INFO: Scrape type for ZV87570: 0
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: AV25336
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV25336%27 HTTP/1.1" 200 None
2026-03-28 07:42:41 [auto1.de] INFO: Scrape type for AV25336: 0
2026-03-28 07:42:41 [auto1.de] INFO: Found listing with ID: YV09971
2026-03-28 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV09971%27 HTTP/1.1" 200 None
2026-03-28 07:42:42 [auto1.de] INFO: Scrape type for YV09971: 0
2026-03-28 07:42:42 [auto1.de] INFO: Found listing with ID: SJ02075
2026-03-28 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02075%27 HTTP/1.1" 200 None
2026-03-28 07:42:42 [auto1.de] INFO: Scrape type for SJ02075: 0
2026-03-28 07:42:42 [auto1.de] INFO: Found listing with ID: NH13691
2026-03-28 07:42:42 [auto1.de] INFO: Found listing with ID: CT53994
2026-03-28 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT53994%27 HTTP/1.1" 200 None
2026-03-28 07:42:42 [auto1.de] INFO: Scrape type for CT53994: 0
2026-03-28 07:42:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:43 [auto1.de] INFO: Channel: 24h | Page: 203 | totalHits: 9266 | hits on page: 40
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: BZ09697
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ09697%27 HTTP/1.1" 200 None
2026-03-28 07:42:43 [auto1.de] INFO: Scrape type for BZ09697: 0
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: HX18202
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: DM27996
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27996%27 HTTP/1.1" 200 None
2026-03-28 07:42:43 [auto1.de] INFO: Scrape type for DM27996: 0
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: TL87064
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL87064%27 HTTP/1.1" 200 None
2026-03-28 07:42:43 [auto1.de] INFO: Scrape type for TL87064: 0
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: KP72429
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: WS69855
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS69855%27 HTTP/1.1" 200 None
2026-03-28 07:42:43 [auto1.de] INFO: Scrape type for WS69855: 0
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: PH96915
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: WW12135
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: MZ98399
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: LN73181
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: DB25597
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB25597%27 HTTP/1.1" 200 None
2026-03-28 07:42:43 [auto1.de] INFO: Scrape type for DB25597: 0
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: LT47109
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT47109%27 HTTP/1.1" 200 None
2026-03-28 07:42:43 [auto1.de] INFO: Scrape type for LT47109: 0
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: ZT78140
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT78140%27 HTTP/1.1" 200 None
2026-03-28 07:42:43 [auto1.de] INFO: Scrape type for ZT78140: 0
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: UY19816
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: EJ97789
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: SY85938
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY85938%27 HTTP/1.1" 200 None
2026-03-28 07:42:43 [auto1.de] INFO: Scrape type for SY85938: 0
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: GU30537
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: WP81367
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP81367%27 HTTP/1.1" 200 None
2026-03-28 07:42:43 [auto1.de] INFO: Scrape type for WP81367: 0
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: VS89530
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89530%27 HTTP/1.1" 200 None
2026-03-28 07:42:43 [auto1.de] INFO: Scrape type for VS89530: 0
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: DU96107
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU96107%27 HTTP/1.1" 200 None
2026-03-28 07:42:43 [auto1.de] INFO: Scrape type for DU96107: 0
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: LS10539
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: EJ80862
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ80862%27 HTTP/1.1" 200 None
2026-03-28 07:42:43 [auto1.de] INFO: Scrape type for EJ80862: 0
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: LB66833
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: ZL98433
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: YS06113
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS06113%27 HTTP/1.1" 200 None
2026-03-28 07:42:43 [auto1.de] INFO: Scrape type for YS06113: 0
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: BP65975
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP65975%27 HTTP/1.1" 200 None
2026-03-28 07:42:43 [auto1.de] INFO: Scrape type for BP65975: 0
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: SL44411
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: PD01129
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: RE17291
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: JJ95706
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ95706%27 HTTP/1.1" 200 None
2026-03-28 07:42:43 [auto1.de] INFO: Scrape type for JJ95706: 0
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: VJ30367
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ30367%27 HTTP/1.1" 200 None
2026-03-28 07:42:43 [auto1.de] INFO: Scrape type for VJ30367: 0
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: RJ05854
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ05854%27 HTTP/1.1" 200 None
2026-03-28 07:42:43 [auto1.de] INFO: Scrape type for RJ05854: 0
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: SD97280
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97280%27 HTTP/1.1" 200 None
2026-03-28 07:42:43 [auto1.de] INFO: Scrape type for SD97280: 0
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: YT67181
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT67181%27 HTTP/1.1" 200 None
2026-03-28 07:42:43 [auto1.de] INFO: Scrape type for YT67181: 0
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: SG31546
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG31546%27 HTTP/1.1" 200 None
2026-03-28 07:42:43 [auto1.de] INFO: Scrape type for SG31546: 0
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: HL98851
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: HE92439
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE92439%27 HTTP/1.1" 200 None
2026-03-28 07:42:43 [auto1.de] INFO: Scrape type for HE92439: 0
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: VV03695
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: FP37093
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP37093%27 HTTP/1.1" 200 None
2026-03-28 07:42:43 [auto1.de] INFO: Scrape type for FP37093: 0
2026-03-28 07:42:43 [auto1.de] INFO: Found listing with ID: RV99753
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV99753%27 HTTP/1.1" 200 None
2026-03-28 07:42:43 [auto1.de] INFO: Scrape type for RV99753: 0
2026-03-28 07:42:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:51 [auto1.de] INFO: Channel: 24h | Page: 204 | totalHits: 9266 | hits on page: 40
2026-03-28 07:42:51 [auto1.de] INFO: Found listing with ID: RZ61544
2026-03-28 07:42:51 [auto1.de] INFO: Found listing with ID: CD36219
2026-03-28 07:42:51 [auto1.de] INFO: Found listing with ID: SL28048
2026-03-28 07:42:51 [auto1.de] INFO: Found listing with ID: WT86563
2026-03-28 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT86563%27 HTTP/1.1" 200 None
2026-03-28 07:42:51 [auto1.de] INFO: Scrape type for WT86563: 0
2026-03-28 07:42:51 [auto1.de] INFO: Found listing with ID: FG21922
2026-03-28 07:42:51 [auto1.de] INFO: Found listing with ID: BV10728
2026-03-28 07:42:51 [auto1.de] INFO: Found listing with ID: HT39177
2026-03-28 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT39177%27 HTTP/1.1" 200 None
2026-03-28 07:42:51 [auto1.de] INFO: Scrape type for HT39177: 0
2026-03-28 07:42:51 [auto1.de] INFO: Found listing with ID: YV93929
2026-03-28 07:42:51 [auto1.de] INFO: Found listing with ID: AJ83009
2026-03-28 07:42:51 [auto1.de] INFO: Found listing with ID: EX93586
2026-03-28 07:42:51 [auto1.de] INFO: Found listing with ID: JU52980
2026-03-28 07:42:51 [auto1.de] INFO: Found listing with ID: TF11415
2026-03-28 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF11415%27 HTTP/1.1" 200 None
2026-03-28 07:42:51 [auto1.de] INFO: Scrape type for TF11415: 0
2026-03-28 07:42:51 [auto1.de] INFO: Found listing with ID: YH44518
2026-03-28 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44518%27 HTTP/1.1" 200 None
2026-03-28 07:42:51 [auto1.de] INFO: Scrape type for YH44518: 0
2026-03-28 07:42:51 [auto1.de] INFO: Found listing with ID: ER78775
2026-03-28 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER78775%27 HTTP/1.1" 200 None
2026-03-28 07:42:51 [auto1.de] INFO: Scrape type for ER78775: 0
2026-03-28 07:42:51 [auto1.de] INFO: Found listing with ID: PS26933
2026-03-28 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS26933%27 HTTP/1.1" 200 None
2026-03-28 07:42:51 [auto1.de] INFO: Scrape type for PS26933: 0
2026-03-28 07:42:51 [auto1.de] INFO: Found listing with ID: JB35967
2026-03-28 07:42:51 [auto1.de] INFO: Found listing with ID: BP45840
2026-03-28 07:42:51 [auto1.de] INFO: Found listing with ID: HB08106
2026-03-28 07:42:51 [auto1.de] INFO: Found listing with ID: ZZ59930
2026-03-28 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ59930%27 HTTP/1.1" 200 None
2026-03-28 07:42:51 [auto1.de] INFO: Scrape type for ZZ59930: 0
2026-03-28 07:42:51 [auto1.de] INFO: Found listing with ID: CE41516
2026-03-28 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE41516%27 HTTP/1.1" 200 None
2026-03-28 07:42:51 [auto1.de] INFO: Scrape type for CE41516: 0
2026-03-28 07:42:51 [auto1.de] INFO: Found listing with ID: TT79830
2026-03-28 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT79830%27 HTTP/1.1" 200 None
2026-03-28 07:42:51 [auto1.de] INFO: Scrape type for TT79830: 0
2026-03-28 07:42:51 [auto1.de] INFO: Found listing with ID: EP39271
2026-03-28 07:42:51 [auto1.de] INFO: Found listing with ID: GM12066
2026-03-28 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM12066%27 HTTP/1.1" 200 None
2026-03-28 07:42:52 [auto1.de] INFO: Scrape type for GM12066: 0
2026-03-28 07:42:52 [auto1.de] INFO: Found listing with ID: NM34350
2026-03-28 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM34350%27 HTTP/1.1" 200 None
2026-03-28 07:42:52 [auto1.de] INFO: Scrape type for NM34350: 0
2026-03-28 07:42:52 [auto1.de] INFO: Found listing with ID: FZ89308
2026-03-28 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ89308%27 HTTP/1.1" 200 None
2026-03-28 07:42:52 [auto1.de] INFO: Scrape type for FZ89308: 0
2026-03-28 07:42:52 [auto1.de] INFO: Found listing with ID: KU58060
2026-03-28 07:42:52 [auto1.de] INFO: Found listing with ID: EC74122
2026-03-28 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC74122%27 HTTP/1.1" 200 None
2026-03-28 07:42:52 [auto1.de] INFO: Scrape type for EC74122: 0
2026-03-28 07:42:52 [auto1.de] INFO: Found listing with ID: LH09734
2026-03-28 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH09734%27 HTTP/1.1" 200 None
2026-03-28 07:42:52 [auto1.de] INFO: Scrape type for LH09734: 0
2026-03-28 07:42:52 [auto1.de] INFO: Found listing with ID: WV16405
2026-03-28 07:42:52 [auto1.de] INFO: Found listing with ID: VE65204
2026-03-28 07:42:52 [auto1.de] INFO: Found listing with ID: XU64075
2026-03-28 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU64075%27 HTTP/1.1" 200 None
2026-03-28 07:42:52 [auto1.de] INFO: Scrape type for XU64075: 0
2026-03-28 07:42:52 [auto1.de] INFO: Found listing with ID: VJ38627
2026-03-28 07:42:52 [auto1.de] INFO: Found listing with ID: YE66083
2026-03-28 07:42:52 [auto1.de] INFO: Found listing with ID: LU00556
2026-03-28 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU00556%27 HTTP/1.1" 200 None
2026-03-28 07:42:52 [auto1.de] INFO: Scrape type for LU00556: 0
2026-03-28 07:42:52 [auto1.de] INFO: Found listing with ID: XR06088
2026-03-28 07:42:52 [auto1.de] INFO: Found listing with ID: MU33695
2026-03-28 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU33695%27 HTTP/1.1" 200 None
2026-03-28 07:42:52 [auto1.de] INFO: Scrape type for MU33695: 0
2026-03-28 07:42:52 [auto1.de] INFO: Found listing with ID: YD55328
2026-03-28 07:42:52 [auto1.de] INFO: Found listing with ID: LH51780
2026-03-28 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH51780%27 HTTP/1.1" 200 None
2026-03-28 07:42:52 [auto1.de] INFO: Scrape type for LH51780: 0
2026-03-28 07:42:52 [auto1.de] INFO: Found listing with ID: VG52113
2026-03-28 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG52113%27 HTTP/1.1" 200 None
2026-03-28 07:42:52 [auto1.de] INFO: Scrape type for VG52113: 0
2026-03-28 07:42:52 [auto1.de] INFO: Found listing with ID: LU75285
2026-03-28 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU75285%27 HTTP/1.1" 200 None
2026-03-28 07:42:52 [auto1.de] INFO: Scrape type for LU75285: 0
2026-03-28 07:42:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:53 [auto1.de] INFO: Channel: 24h | Page: 205 | totalHits: 9266 | hits on page: 40
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: AJ71122
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ71122%27 HTTP/1.1" 200 None
2026-03-28 07:42:53 [auto1.de] INFO: Scrape type for AJ71122: 0
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: DF45808
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: SV69616
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69616%27 HTTP/1.1" 200 None
2026-03-28 07:42:53 [auto1.de] INFO: Scrape type for SV69616: 0
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: CH61883
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH61883%27 HTTP/1.1" 200 None
2026-03-28 07:42:53 [auto1.de] INFO: Scrape type for CH61883: 0
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: SA68147
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: DK64287
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: ZN63350
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN63350%27 HTTP/1.1" 200 None
2026-03-28 07:42:53 [auto1.de] INFO: Scrape type for ZN63350: 0
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: CW59742
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW59742%27 HTTP/1.1" 200 None
2026-03-28 07:42:53 [auto1.de] INFO: Scrape type for CW59742: 0
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: WD52714
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: DY67323
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: GV91046
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91046%27 HTTP/1.1" 200 None
2026-03-28 07:42:53 [auto1.de] INFO: Scrape type for GV91046: 0
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: LK48428
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK48428%27 HTTP/1.1" 200 None
2026-03-28 07:42:53 [auto1.de] INFO: Scrape type for LK48428: 0
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: HM04457
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM04457%27 HTTP/1.1" 200 None
2026-03-28 07:42:53 [auto1.de] INFO: Scrape type for HM04457: 0
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: WP61796
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP61796%27 HTTP/1.1" 200 None
2026-03-28 07:42:53 [auto1.de] INFO: Scrape type for WP61796: 0
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: DE42625
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42625%27 HTTP/1.1" 200 None
2026-03-28 07:42:53 [auto1.de] INFO: Scrape type for DE42625: 0
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: AX24898
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX24898%27 HTTP/1.1" 200 None
2026-03-28 07:42:53 [auto1.de] INFO: Scrape type for AX24898: 0
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: FA59135
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA59135%27 HTTP/1.1" 200 None
2026-03-28 07:42:53 [auto1.de] INFO: Scrape type for FA59135: 0
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: MU44330
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU44330%27 HTTP/1.1" 200 None
2026-03-28 07:42:53 [auto1.de] INFO: Scrape type for MU44330: 0
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: NF75522
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: EJ83325
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: KX79678
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX79678%27 HTTP/1.1" 200 None
2026-03-28 07:42:53 [auto1.de] INFO: Scrape type for KX79678: 0
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: GA28860
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: JL37437
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: DG62846
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: NB80689
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: VV98645
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: NN79660
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: JV89856
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: KG22409
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: PL79897
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: JY04435
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY04435%27 HTTP/1.1" 200 None
2026-03-28 07:42:53 [auto1.de] INFO: Scrape type for JY04435: 0
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: HD41373
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: YX31470
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: YJ23133
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ23133%27 HTTP/1.1" 200 None
2026-03-28 07:42:53 [auto1.de] INFO: Scrape type for YJ23133: 0
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: PC35903
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: GD48947
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: JS29851
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: SD67792
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD67792%27 HTTP/1.1" 200 None
2026-03-28 07:42:53 [auto1.de] INFO: Scrape type for SD67792: 0
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: ET35150
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET35150%27 HTTP/1.1" 200 None
2026-03-28 07:42:53 [auto1.de] INFO: Scrape type for ET35150: 0
2026-03-28 07:42:53 [auto1.de] INFO: Found listing with ID: JW09174
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW09174%27 HTTP/1.1" 200 None
2026-03-28 07:42:53 [auto1.de] INFO: Scrape type for JW09174: 0
2026-03-28 07:42:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:54 [auto1.de] INFO: Channel: 24h | Page: 206 | totalHits: 9266 | hits on page: 40
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: TB33384
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: WZ21973
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: SA82608
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA82608%27 HTTP/1.1" 200 None
2026-03-28 07:42:54 [auto1.de] INFO: Scrape type for SA82608: 0
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: RB25738
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: PR56411
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: KC98509
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: SD64601
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: PA30689
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: EH74831
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH74831%27 HTTP/1.1" 200 None
2026-03-28 07:42:54 [auto1.de] INFO: Scrape type for EH74831: 0
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: SD72223
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: DK31638
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK31638%27 HTTP/1.1" 200 None
2026-03-28 07:42:54 [auto1.de] INFO: Scrape type for DK31638: 0
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: CA50565
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA50565%27 HTTP/1.1" 200 None
2026-03-28 07:42:54 [auto1.de] INFO: Scrape type for CA50565: 0
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: WE87101
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: XR26970
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR26970%27 HTTP/1.1" 200 None
2026-03-28 07:42:54 [auto1.de] INFO: Scrape type for XR26970: 0
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: UE57150
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE57150%27 HTTP/1.1" 200 None
2026-03-28 07:42:54 [auto1.de] INFO: Scrape type for UE57150: 0
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: JB08013
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: LT21646
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT21646%27 HTTP/1.1" 200 None
2026-03-28 07:42:54 [auto1.de] INFO: Scrape type for LT21646: 0
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: WP04220
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP04220%27 HTTP/1.1" 200 None
2026-03-28 07:42:54 [auto1.de] INFO: Scrape type for WP04220: 0
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: HB50510
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB50510%27 HTTP/1.1" 200 None
2026-03-28 07:42:54 [auto1.de] INFO: Scrape type for HB50510: 0
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: XP96351
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP96351%27 HTTP/1.1" 200 None
2026-03-28 07:42:54 [auto1.de] INFO: Scrape type for XP96351: 0
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: SR18060
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: EP38579
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP38579%27 HTTP/1.1" 200 None
2026-03-28 07:42:54 [auto1.de] INFO: Scrape type for EP38579: 0
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: CK11382
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: BJ60837
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ60837%27 HTTP/1.1" 200 None
2026-03-28 07:42:54 [auto1.de] INFO: Scrape type for BJ60837: 0
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: EJ54624
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ54624%27 HTTP/1.1" 200 None
2026-03-28 07:42:54 [auto1.de] INFO: Scrape type for EJ54624: 0
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: TV47355
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: MK04993
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: VN95277
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN95277%27 HTTP/1.1" 200 None
2026-03-28 07:42:54 [auto1.de] INFO: Scrape type for VN95277: 0
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: TJ67594
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ67594%27 HTTP/1.1" 200 None
2026-03-28 07:42:54 [auto1.de] INFO: Scrape type for TJ67594: 0
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: YN35790
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN35790%27 HTTP/1.1" 200 None
2026-03-28 07:42:54 [auto1.de] INFO: Scrape type for YN35790: 0
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: XP57282
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: CZ09118
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: NL95797
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: LM29335
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: DW90276
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW90276%27 HTTP/1.1" 200 None
2026-03-28 07:42:54 [auto1.de] INFO: Scrape type for DW90276: 0
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: AW80803
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: CF02627
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF02627%27 HTTP/1.1" 200 None
2026-03-28 07:42:54 [auto1.de] INFO: Scrape type for CF02627: 0
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: SR77795
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR77795%27 HTTP/1.1" 200 None
2026-03-28 07:42:54 [auto1.de] INFO: Scrape type for SR77795: 0
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: SK86846
2026-03-28 07:42:54 [auto1.de] INFO: Found listing with ID: TD26953
2026-03-28 07:42:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:42:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:42:55 [auto1.de] INFO: Channel: 24h | Page: 207 | totalHits: 9266 | hits on page: 40
2026-03-28 07:42:55 [auto1.de] INFO: Found listing with ID: BS26605
2026-03-28 07:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS26605%27 HTTP/1.1" 200 None
2026-03-28 07:42:55 [auto1.de] INFO: Scrape type for BS26605: 0
2026-03-28 07:42:55 [auto1.de] INFO: Found listing with ID: NV13181
2026-03-28 07:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV13181%27 HTTP/1.1" 200 None
2026-03-28 07:42:55 [auto1.de] INFO: Scrape type for NV13181: 0
2026-03-28 07:42:55 [auto1.de] INFO: Found listing with ID: EC25925
2026-03-28 07:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC25925%27 HTTP/1.1" 200 None
2026-03-28 07:42:55 [auto1.de] INFO: Scrape type for EC25925: 0
2026-03-28 07:42:55 [auto1.de] INFO: Found listing with ID: DW78199
2026-03-28 07:42:55 [auto1.de] INFO: Found listing with ID: CV81199
2026-03-28 07:42:55 [auto1.de] INFO: Found listing with ID: VX34650
2026-03-28 07:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX34650%27 HTTP/1.1" 200 None
2026-03-28 07:42:55 [auto1.de] INFO: Scrape type for VX34650: 0
2026-03-28 07:42:55 [auto1.de] INFO: Found listing with ID: XM89515
2026-03-28 07:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM89515%27 HTTP/1.1" 200 None
2026-03-28 07:42:55 [auto1.de] INFO: Scrape type for XM89515: 0
2026-03-28 07:42:55 [auto1.de] INFO: Found listing with ID: UC14298
2026-03-28 07:42:55 [auto1.de] INFO: Found listing with ID: AZ37362
2026-03-28 07:42:55 [auto1.de] INFO: Found listing with ID: AS09440
2026-03-28 07:42:55 [auto1.de] INFO: Found listing with ID: LG36185
2026-03-28 07:42:55 [auto1.de] INFO: Found listing with ID: DW00961
2026-03-28 07:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW00961%27 HTTP/1.1" 200 None
2026-03-28 07:42:55 [auto1.de] INFO: Scrape type for DW00961: 0
2026-03-28 07:42:55 [auto1.de] INFO: Found listing with ID: BH48904
2026-03-28 07:42:55 [auto1.de] INFO: Found listing with ID: KF96570
2026-03-28 07:42:55 [auto1.de] INFO: Found listing with ID: FG75722
2026-03-28 07:42:55 [auto1.de] INFO: Found listing with ID: AA34634
2026-03-28 07:42:55 [auto1.de] INFO: Found listing with ID: DU27539
2026-03-28 07:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU27539%27 HTTP/1.1" 200 None
2026-03-28 07:42:55 [auto1.de] INFO: Scrape type for DU27539: 0
2026-03-28 07:42:55 [auto1.de] INFO: Found listing with ID: JE48122
2026-03-28 07:42:55 [auto1.de] INFO: Found listing with ID: MC22222
2026-03-28 07:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC22222%27 HTTP/1.1" 200 None
2026-03-28 07:42:55 [auto1.de] INFO: Scrape type for MC22222: 0
2026-03-28 07:42:55 [auto1.de] INFO: Found listing with ID: KF91285
2026-03-28 07:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF91285%27 HTTP/1.1" 200 None
2026-03-28 07:42:56 [auto1.de] INFO: Scrape type for KF91285: 0
2026-03-28 07:42:56 [auto1.de] INFO: Found listing with ID: WV94095
2026-03-28 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV94095%27 HTTP/1.1" 200 None
2026-03-28 07:42:56 [auto1.de] INFO: Scrape type for WV94095: 0
2026-03-28 07:42:56 [auto1.de] INFO: Found listing with ID: VN50855
2026-03-28 07:42:56 [auto1.de] INFO: Found listing with ID: KE73798
2026-03-28 07:42:56 [auto1.de] INFO: Found listing with ID: RB77182
2026-03-28 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB77182%27 HTTP/1.1" 200 None
2026-03-28 07:42:56 [auto1.de] INFO: Scrape type for RB77182: 0
2026-03-28 07:42:56 [auto1.de] INFO: Found listing with ID: XH41107
2026-03-28 07:42:56 [auto1.de] INFO: Found listing with ID: TV17454
2026-03-28 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV17454%27 HTTP/1.1" 200 None
2026-03-28 07:42:56 [auto1.de] INFO: Scrape type for TV17454: 0
2026-03-28 07:42:56 [auto1.de] INFO: Found listing with ID: VJ90236
2026-03-28 07:42:56 [auto1.de] INFO: Found listing with ID: TS61714
2026-03-28 07:42:56 [auto1.de] INFO: Found listing with ID: WZ35506
2026-03-28 07:42:56 [auto1.de] INFO: Found listing with ID: JU77482
2026-03-28 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU77482%27 HTTP/1.1" 200 None
2026-03-28 07:42:56 [auto1.de] INFO: Scrape type for JU77482: 0
2026-03-28 07:42:56 [auto1.de] INFO: Found listing with ID: KU38253
2026-03-28 07:42:56 [auto1.de] INFO: Found listing with ID: DR94699
2026-03-28 07:42:56 [auto1.de] INFO: Found listing with ID: NX68514
2026-03-28 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68514%27 HTTP/1.1" 200 None
2026-03-28 07:42:56 [auto1.de] INFO: Scrape type for NX68514: 0
2026-03-28 07:42:56 [auto1.de] INFO: Found listing with ID: BV74864
2026-03-28 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV74864%27 HTTP/1.1" 200 None
2026-03-28 07:42:56 [auto1.de] INFO: Scrape type for BV74864: 0
2026-03-28 07:42:56 [auto1.de] INFO: Found listing with ID: TU33144
2026-03-28 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU33144%27 HTTP/1.1" 200 None
2026-03-28 07:42:56 [auto1.de] INFO: Scrape type for TU33144: 0
2026-03-28 07:42:56 [auto1.de] INFO: Found listing with ID: GG98787
2026-03-28 07:42:56 [auto1.de] INFO: Found listing with ID: KX98394
2026-03-28 07:42:56 [auto1.de] INFO: Found listing with ID: GE96921
2026-03-28 07:42:56 [auto1.de] INFO: Found listing with ID: CW96119
2026-03-28 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW96119%27 HTTP/1.1" 200 None
2026-03-28 07:42:56 [auto1.de] INFO: Scrape type for CW96119: 0
2026-03-28 07:42:56 [auto1.de] INFO: Found listing with ID: BJ86438
2026-03-28 07:42:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:43:06 [scrapy.extensions.logstats] INFO: Crawled 213 pages (at 22 pages/min), scraped 475 items (at 0 items/min)
2026-03-28 07:43:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 165MiB
2026-03-28 07:43:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:43:27 [auto1.de] INFO: Channel: 24h | Page: 208 | totalHits: 9266 | hits on page: 40
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: YN77653
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN77653%27 HTTP/1.1" 200 None
2026-03-28 07:43:27 [auto1.de] INFO: Scrape type for YN77653: 0
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: CH51511
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: TR21109
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: ZV84359
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV84359%27 HTTP/1.1" 200 None
2026-03-28 07:43:27 [auto1.de] INFO: Scrape type for ZV84359: 0
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: ZL15649
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL15649%27 HTTP/1.1" 200 None
2026-03-28 07:43:27 [auto1.de] INFO: Scrape type for ZL15649: 0
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: VX13516
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX13516%27 HTTP/1.1" 200 None
2026-03-28 07:43:27 [auto1.de] INFO: Scrape type for VX13516: 0
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: WK71622
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: JL65692
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL65692%27 HTTP/1.1" 200 None
2026-03-28 07:43:27 [auto1.de] INFO: Scrape type for JL65692: 0
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: ED74506
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: GA75258
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA75258%27 HTTP/1.1" 200 None
2026-03-28 07:43:27 [auto1.de] INFO: Scrape type for GA75258: 0
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: EX10887
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX10887%27 HTTP/1.1" 200 None
2026-03-28 07:43:27 [auto1.de] INFO: Scrape type for EX10887: 0
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: WT60095
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT60095%27 HTTP/1.1" 200 None
2026-03-28 07:43:27 [auto1.de] INFO: Scrape type for WT60095: 0
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: AG53647
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: RZ52630
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: GY78752
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: HS53864
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS53864%27 HTTP/1.1" 200 None
2026-03-28 07:43:27 [auto1.de] INFO: Scrape type for HS53864: 0
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: AH97983
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH97983%27 HTTP/1.1" 200 None
2026-03-28 07:43:27 [auto1.de] INFO: Scrape type for AH97983: 0
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: ED00109
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED00109%27 HTTP/1.1" 200 None
2026-03-28 07:43:27 [auto1.de] INFO: Scrape type for ED00109: 0
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: TV77789
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV77789%27 HTTP/1.1" 200 None
2026-03-28 07:43:27 [auto1.de] INFO: Scrape type for TV77789: 0
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: XR43208
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR43208%27 HTTP/1.1" 200 None
2026-03-28 07:43:27 [auto1.de] INFO: Scrape type for XR43208: 0
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: KN65444
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN65444%27 HTTP/1.1" 200 None
2026-03-28 07:43:27 [auto1.de] INFO: Scrape type for KN65444: 0
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: LK29782
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK29782%27 HTTP/1.1" 200 None
2026-03-28 07:43:27 [auto1.de] INFO: Scrape type for LK29782: 0
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: SC70285
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC70285%27 HTTP/1.1" 200 None
2026-03-28 07:43:27 [auto1.de] INFO: Scrape type for SC70285: 0
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: CZ94450
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ94450%27 HTTP/1.1" 200 None
2026-03-28 07:43:27 [auto1.de] INFO: Scrape type for CZ94450: 0
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: HJ79355
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: TF63689
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF63689%27 HTTP/1.1" 200 None
2026-03-28 07:43:27 [auto1.de] INFO: Scrape type for TF63689: 0
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: WW16724
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW16724%27 HTTP/1.1" 200 None
2026-03-28 07:43:27 [auto1.de] INFO: Scrape type for WW16724: 0
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: WW95477
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: EB33579
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB33579%27 HTTP/1.1" 200 None
2026-03-28 07:43:27 [auto1.de] INFO: Scrape type for EB33579: 0
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: DJ77655
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: DX68266
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX68266%27 HTTP/1.1" 200 None
2026-03-28 07:43:27 [auto1.de] INFO: Scrape type for DX68266: 0
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: TF26076
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF26076%27 HTTP/1.1" 200 None
2026-03-28 07:43:27 [auto1.de] INFO: Scrape type for TF26076: 0
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: TV60687
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV60687%27 HTTP/1.1" 200 None
2026-03-28 07:43:27 [auto1.de] INFO: Scrape type for TV60687: 0
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: KL29911
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL29911%27 HTTP/1.1" 200 None
2026-03-28 07:43:27 [auto1.de] INFO: Scrape type for KL29911: 0
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: RM40239
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: JL50388
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: FM97642
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: UH05961
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: GA86041
2026-03-28 07:43:27 [auto1.de] INFO: Found listing with ID: SU94182
2026-03-28 07:43:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:43:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:43:28 [auto1.de] INFO: Channel: 24h | Page: 209 | totalHits: 9266 | hits on page: 40
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: GX08405
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: TH70911
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH70911%27 HTTP/1.1" 200 None
2026-03-28 07:43:28 [auto1.de] INFO: Scrape type for TH70911: 0
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: CK84203
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK84203%27 HTTP/1.1" 200 None
2026-03-28 07:43:28 [auto1.de] INFO: Scrape type for CK84203: 0
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: UD17279
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: ZE40568
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE40568%27 HTTP/1.1" 200 None
2026-03-28 07:43:28 [auto1.de] INFO: Scrape type for ZE40568: 0
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: WU34060
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: PC86421
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: FK97856
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK97856%27 HTTP/1.1" 200 None
2026-03-28 07:43:28 [auto1.de] INFO: Scrape type for FK97856: 0
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: PT78073
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: DT94754
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: MG70959
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: WE44185
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE44185%27 HTTP/1.1" 200 None
2026-03-28 07:43:28 [auto1.de] INFO: Scrape type for WE44185: 0
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: NN66597
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN66597%27 HTTP/1.1" 200 None
2026-03-28 07:43:28 [auto1.de] INFO: Scrape type for NN66597: 0
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: AU40553
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: XB90216
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB90216%27 HTTP/1.1" 200 None
2026-03-28 07:43:28 [auto1.de] INFO: Scrape type for XB90216: 0
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: LB47051
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB47051%27 HTTP/1.1" 200 None
2026-03-28 07:43:28 [auto1.de] INFO: Scrape type for LB47051: 0
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: NR01003
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR01003%27 HTTP/1.1" 200 None
2026-03-28 07:43:28 [auto1.de] INFO: Scrape type for NR01003: 0
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: ES68108
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: KZ08446
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: LL09257
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09257%27 HTTP/1.1" 200 None
2026-03-28 07:43:28 [auto1.de] INFO: Scrape type for LL09257: 0
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: AR53020
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR53020%27 HTTP/1.1" 200 None
2026-03-28 07:43:28 [auto1.de] INFO: Scrape type for AR53020: 0
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: VE16712
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: SA06109
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA06109%27 HTTP/1.1" 200 None
2026-03-28 07:43:28 [auto1.de] INFO: Scrape type for SA06109: 0
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: AE21884
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE21884%27 HTTP/1.1" 200 None
2026-03-28 07:43:28 [auto1.de] INFO: Scrape type for AE21884: 0
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: SZ48596
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ48596%27 HTTP/1.1" 200 None
2026-03-28 07:43:28 [auto1.de] INFO: Scrape type for SZ48596: 0
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: YH85992
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH85992%27 HTTP/1.1" 200 None
2026-03-28 07:43:28 [auto1.de] INFO: Scrape type for YH85992: 0
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: VZ83010
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: VG18386
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: EC33073
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33073%27 HTTP/1.1" 200 None
2026-03-28 07:43:28 [auto1.de] INFO: Scrape type for EC33073: 0
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: XV53612
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: LR06917
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR06917%27 HTTP/1.1" 200 None
2026-03-28 07:43:28 [auto1.de] INFO: Scrape type for LR06917: 0
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: CR11100
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR11100%27 HTTP/1.1" 200 None
2026-03-28 07:43:28 [auto1.de] INFO: Scrape type for CR11100: 0
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: NY09817
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY09817%27 HTTP/1.1" 200 None
2026-03-28 07:43:28 [auto1.de] INFO: Scrape type for NY09817: 0
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: BC20634
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: SL47086
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL47086%27 HTTP/1.1" 200 None
2026-03-28 07:43:28 [auto1.de] INFO: Scrape type for SL47086: 0
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: VN06043
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN06043%27 HTTP/1.1" 200 None
2026-03-28 07:43:28 [auto1.de] INFO: Scrape type for VN06043: 0
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: EB01944
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB01944%27 HTTP/1.1" 200 None
2026-03-28 07:43:28 [auto1.de] INFO: Scrape type for EB01944: 0
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: HY33546
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: TF52264
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF52264%27 HTTP/1.1" 200 None
2026-03-28 07:43:28 [auto1.de] INFO: Scrape type for TF52264: 0
2026-03-28 07:43:28 [auto1.de] INFO: Found listing with ID: MM42204
2026-03-28 07:43:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:43:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:43:29 [auto1.de] INFO: Channel: 24h | Page: 210 | totalHits: 9266 | hits on page: 40
2026-03-28 07:43:29 [auto1.de] INFO: Found listing with ID: MK56575
2026-03-28 07:43:29 [auto1.de] INFO: Found listing with ID: TY82930
2026-03-28 07:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY82930%27 HTTP/1.1" 200 None
2026-03-28 07:43:29 [auto1.de] INFO: Scrape type for TY82930: 0
2026-03-28 07:43:29 [auto1.de] INFO: Found listing with ID: XC92552
2026-03-28 07:43:29 [auto1.de] INFO: Found listing with ID: WT06361
2026-03-28 07:43:29 [auto1.de] INFO: Found listing with ID: MG94250
2026-03-28 07:43:29 [auto1.de] INFO: Found listing with ID: BU63404
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: ND33880
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND33880%27 HTTP/1.1" 200 None
2026-03-28 07:43:30 [auto1.de] INFO: Scrape type for ND33880: 0
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: AR51863
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: PR96123
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: GE71981
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: ZH23061
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: TU29288
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU29288%27 HTTP/1.1" 200 None
2026-03-28 07:43:30 [auto1.de] INFO: Scrape type for TU29288: 0
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: EZ94089
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ94089%27 HTTP/1.1" 200 None
2026-03-28 07:43:30 [auto1.de] INFO: Scrape type for EZ94089: 0
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: YT04304
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT04304%27 HTTP/1.1" 200 None
2026-03-28 07:43:30 [auto1.de] INFO: Scrape type for YT04304: 0
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: CZ89661
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ89661%27 HTTP/1.1" 200 None
2026-03-28 07:43:30 [auto1.de] INFO: Scrape type for CZ89661: 0
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: XN32134
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN32134%27 HTTP/1.1" 200 None
2026-03-28 07:43:30 [auto1.de] INFO: Scrape type for XN32134: 0
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: ZS84546
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS84546%27 HTTP/1.1" 200 None
2026-03-28 07:43:30 [auto1.de] INFO: Scrape type for ZS84546: 0
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: TW39351
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: SH26484
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH26484%27 HTTP/1.1" 200 None
2026-03-28 07:43:30 [auto1.de] INFO: Scrape type for SH26484: 0
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: DJ32425
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ32425%27 HTTP/1.1" 200 None
2026-03-28 07:43:30 [auto1.de] INFO: Scrape type for DJ32425: 0
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: VK44645
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: HX34455
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX34455%27 HTTP/1.1" 200 None
2026-03-28 07:43:30 [auto1.de] INFO: Scrape type for HX34455: 0
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: DV91076
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV91076%27 HTTP/1.1" 200 None
2026-03-28 07:43:30 [auto1.de] INFO: Scrape type for DV91076: 0
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: ZU26768
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU26768%27 HTTP/1.1" 200 None
2026-03-28 07:43:30 [auto1.de] INFO: Scrape type for ZU26768: 0
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: AE67956
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: KD49468
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: SA11985
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: RX21062
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21062%27 HTTP/1.1" 200 None
2026-03-28 07:43:30 [auto1.de] INFO: Scrape type for RX21062: 0
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: PH00058
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: MJ48017
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: GU43225
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU43225%27 HTTP/1.1" 200 None
2026-03-28 07:43:30 [auto1.de] INFO: Scrape type for GU43225: 0
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: FD07804
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD07804%27 HTTP/1.1" 200 None
2026-03-28 07:43:30 [auto1.de] INFO: Scrape type for FD07804: 0
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: FC29722
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC29722%27 HTTP/1.1" 200 None
2026-03-28 07:43:30 [auto1.de] INFO: Scrape type for FC29722: 0
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: LG31115
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG31115%27 HTTP/1.1" 200 None
2026-03-28 07:43:30 [auto1.de] INFO: Scrape type for LG31115: 0
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: NY75190
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY75190%27 HTTP/1.1" 200 None
2026-03-28 07:43:30 [auto1.de] INFO: Scrape type for NY75190: 0
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: TB49418
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB49418%27 HTTP/1.1" 200 None
2026-03-28 07:43:30 [auto1.de] INFO: Scrape type for TB49418: 0
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: HH04622
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: HX44464
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX44464%27 HTTP/1.1" 200 None
2026-03-28 07:43:30 [auto1.de] INFO: Scrape type for HX44464: 0
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: DC16754
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC16754%27 HTTP/1.1" 200 None
2026-03-28 07:43:30 [auto1.de] INFO: Scrape type for DC16754: 0
2026-03-28 07:43:30 [auto1.de] INFO: Found listing with ID: VU47138
2026-03-28 07:43:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:43:32 [auto1.de] INFO: Channel: 24h | Page: 211 | totalHits: 9266 | hits on page: 40
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: XV26734
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: PE37736
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: GR86063
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR86063%27 HTTP/1.1" 200 None
2026-03-28 07:43:32 [auto1.de] INFO: Scrape type for GR86063: 0
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: JN95479
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: FZ44442
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: YM75197
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM75197%27 HTTP/1.1" 200 None
2026-03-28 07:43:32 [auto1.de] INFO: Scrape type for YM75197: 0
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: KZ05104
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: MJ96775
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: XS50717
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50717%27 HTTP/1.1" 200 None
2026-03-28 07:43:32 [auto1.de] INFO: Scrape type for XS50717: 0
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: UL70410
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL70410%27 HTTP/1.1" 200 None
2026-03-28 07:43:32 [auto1.de] INFO: Scrape type for UL70410: 0
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: SP67485
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: KM66171
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM66171%27 HTTP/1.1" 200 None
2026-03-28 07:43:32 [auto1.de] INFO: Scrape type for KM66171: 0
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: TK73674
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK73674%27 HTTP/1.1" 200 None
2026-03-28 07:43:32 [auto1.de] INFO: Scrape type for TK73674: 0
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: GK51404
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK51404%27 HTTP/1.1" 200 None
2026-03-28 07:43:32 [auto1.de] INFO: Scrape type for GK51404: 0
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: BA65327
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: CT00605
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT00605%27 HTTP/1.1" 200 None
2026-03-28 07:43:32 [auto1.de] INFO: Scrape type for CT00605: 0
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: XF83287
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF83287%27 HTTP/1.1" 200 None
2026-03-28 07:43:32 [auto1.de] INFO: Scrape type for XF83287: 0
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: YL63918
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL63918%27 HTTP/1.1" 200 None
2026-03-28 07:43:32 [auto1.de] INFO: Scrape type for YL63918: 0
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: XV50981
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: LJ65077
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ65077%27 HTTP/1.1" 200 None
2026-03-28 07:43:32 [auto1.de] INFO: Scrape type for LJ65077: 0
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: TN14580
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN14580%27 HTTP/1.1" 200 None
2026-03-28 07:43:32 [auto1.de] INFO: Scrape type for TN14580: 0
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: ZU42459
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU42459%27 HTTP/1.1" 200 None
2026-03-28 07:43:32 [auto1.de] INFO: Scrape type for ZU42459: 0
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: JK50656
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: AN13363
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN13363%27 HTTP/1.1" 200 None
2026-03-28 07:43:32 [auto1.de] INFO: Scrape type for AN13363: 0
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: ZL89473
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: GJ36407
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ36407%27 HTTP/1.1" 200 None
2026-03-28 07:43:32 [auto1.de] INFO: Scrape type for GJ36407: 0
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: NW35011
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW35011%27 HTTP/1.1" 200 None
2026-03-28 07:43:32 [auto1.de] INFO: Scrape type for NW35011: 0
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: MK08111
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: CT18435
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: YD09657
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD09657%27 HTTP/1.1" 200 None
2026-03-28 07:43:32 [auto1.de] INFO: Scrape type for YD09657: 0
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: XN51512
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN51512%27 HTTP/1.1" 200 None
2026-03-28 07:43:32 [auto1.de] INFO: Scrape type for XN51512: 0
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: RR13548
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: NM84530
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM84530%27 HTTP/1.1" 200 None
2026-03-28 07:43:32 [auto1.de] INFO: Scrape type for NM84530: 0
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: GK55952
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: MS73974
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS73974%27 HTTP/1.1" 200 None
2026-03-28 07:43:32 [auto1.de] INFO: Scrape type for MS73974: 0
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: VN46305
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN46305%27 HTTP/1.1" 200 None
2026-03-28 07:43:32 [auto1.de] INFO: Scrape type for VN46305: 0
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: AS21942
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS21942%27 HTTP/1.1" 200 None
2026-03-28 07:43:32 [auto1.de] INFO: Scrape type for AS21942: 0
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: RD63050
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD63050%27 HTTP/1.1" 200 None
2026-03-28 07:43:32 [auto1.de] INFO: Scrape type for RD63050: 0
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: LS92843
2026-03-28 07:43:32 [auto1.de] INFO: Found listing with ID: HC91159
2026-03-28 07:43:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:43:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:43:33 [auto1.de] INFO: Channel: 24h | Page: 212 | totalHits: 9266 | hits on page: 40
2026-03-28 07:43:33 [auto1.de] INFO: Found listing with ID: JK39186
2026-03-28 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK39186%27 HTTP/1.1" 200 None
2026-03-28 07:43:33 [auto1.de] INFO: Scrape type for JK39186: 0
2026-03-28 07:43:33 [auto1.de] INFO: Found listing with ID: YZ54178
2026-03-28 07:43:33 [auto1.de] INFO: Found listing with ID: TV11727
2026-03-28 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV11727%27 HTTP/1.1" 200 None
2026-03-28 07:43:33 [auto1.de] INFO: Scrape type for TV11727: 0
2026-03-28 07:43:33 [auto1.de] INFO: Found listing with ID: HX75388
2026-03-28 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX75388%27 HTTP/1.1" 200 None
2026-03-28 07:43:33 [auto1.de] INFO: Scrape type for HX75388: 0
2026-03-28 07:43:33 [auto1.de] INFO: Found listing with ID: NZ01572
2026-03-28 07:43:33 [auto1.de] INFO: Found listing with ID: FK87284
2026-03-28 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK87284%27 HTTP/1.1" 200 None
2026-03-28 07:43:33 [auto1.de] INFO: Scrape type for FK87284: 0
2026-03-28 07:43:33 [auto1.de] INFO: Found listing with ID: EX44757
2026-03-28 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX44757%27 HTTP/1.1" 200 None
2026-03-28 07:43:33 [auto1.de] INFO: Scrape type for EX44757: 0
2026-03-28 07:43:33 [auto1.de] INFO: Found listing with ID: UX30716
2026-03-28 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX30716%27 HTTP/1.1" 200 None
2026-03-28 07:43:33 [auto1.de] INFO: Scrape type for UX30716: 0
2026-03-28 07:43:33 [auto1.de] INFO: Found listing with ID: CE68759
2026-03-28 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE68759%27 HTTP/1.1" 200 None
2026-03-28 07:43:34 [auto1.de] INFO: Scrape type for CE68759: 0
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: BZ96817
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ96817%27 HTTP/1.1" 200 None
2026-03-28 07:43:34 [auto1.de] INFO: Scrape type for BZ96817: 0
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: LZ15789
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ15789%27 HTTP/1.1" 200 None
2026-03-28 07:43:34 [auto1.de] INFO: Scrape type for LZ15789: 0
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: BP97465
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: DE42572
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42572%27 HTTP/1.1" 200 None
2026-03-28 07:43:34 [auto1.de] INFO: Scrape type for DE42572: 0
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: TV18739
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV18739%27 HTTP/1.1" 200 None
2026-03-28 07:43:34 [auto1.de] INFO: Scrape type for TV18739: 0
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: PN31203
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN31203%27 HTTP/1.1" 200 None
2026-03-28 07:43:34 [auto1.de] INFO: Scrape type for PN31203: 0
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: ZG62657
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG62657%27 HTTP/1.1" 200 None
2026-03-28 07:43:34 [auto1.de] INFO: Scrape type for ZG62657: 0
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: HB27474
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: FC76019
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC76019%27 HTTP/1.1" 200 None
2026-03-28 07:43:34 [auto1.de] INFO: Scrape type for FC76019: 0
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: DZ26190
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: JG35044
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35044%27 HTTP/1.1" 200 None
2026-03-28 07:43:34 [auto1.de] INFO: Scrape type for JG35044: 0
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: FG09102
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG09102%27 HTTP/1.1" 200 None
2026-03-28 07:43:34 [auto1.de] INFO: Scrape type for FG09102: 0
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: ZV61779
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: BY18365
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY18365%27 HTTP/1.1" 200 None
2026-03-28 07:43:34 [auto1.de] INFO: Scrape type for BY18365: 0
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: BE52525
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE52525%27 HTTP/1.1" 200 None
2026-03-28 07:43:34 [auto1.de] INFO: Scrape type for BE52525: 0
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: MB36683
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB36683%27 HTTP/1.1" 200 None
2026-03-28 07:43:34 [auto1.de] INFO: Scrape type for MB36683: 0
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: FY57679
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: PT08625
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT08625%27 HTTP/1.1" 200 None
2026-03-28 07:43:34 [auto1.de] INFO: Scrape type for PT08625: 0
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: PG24864
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24864%27 HTTP/1.1" 200 None
2026-03-28 07:43:34 [auto1.de] INFO: Scrape type for PG24864: 0
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: JY20975
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: YD14218
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD14218%27 HTTP/1.1" 200 None
2026-03-28 07:43:34 [auto1.de] INFO: Scrape type for YD14218: 0
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: JK09354
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: SG17640
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG17640%27 HTTP/1.1" 200 None
2026-03-28 07:43:34 [auto1.de] INFO: Scrape type for SG17640: 0
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: YZ38333
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ38333%27 HTTP/1.1" 200 None
2026-03-28 07:43:34 [auto1.de] INFO: Scrape type for YZ38333: 0
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: SL77379
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: AZ42176
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: AB26225
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB26225%27 HTTP/1.1" 200 None
2026-03-28 07:43:34 [auto1.de] INFO: Scrape type for AB26225: 0
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: SE32009
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE32009%27 HTTP/1.1" 200 None
2026-03-28 07:43:34 [auto1.de] INFO: Scrape type for SE32009: 0
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: XJ52823
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: RR41525
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR41525%27 HTTP/1.1" 200 None
2026-03-28 07:43:34 [auto1.de] INFO: Scrape type for RR41525: 0
2026-03-28 07:43:34 [auto1.de] INFO: Found listing with ID: UH96912
2026-03-28 07:43:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:43:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:43:35 [auto1.de] INFO: Channel: 24h | Page: 213 | totalHits: 9266 | hits on page: 40
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: LN23623
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: ZV40367
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV40367%27 HTTP/1.1" 200 None
2026-03-28 07:43:35 [auto1.de] INFO: Scrape type for ZV40367: 0
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: GS33010
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS33010%27 HTTP/1.1" 200 None
2026-03-28 07:43:35 [auto1.de] INFO: Scrape type for GS33010: 0
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: LK17231
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK17231%27 HTTP/1.1" 200 None
2026-03-28 07:43:35 [auto1.de] INFO: Scrape type for LK17231: 0
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: YJ71992
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ71992%27 HTTP/1.1" 200 None
2026-03-28 07:43:35 [auto1.de] INFO: Scrape type for YJ71992: 0
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: TY20606
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: GD49252
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: CJ15757
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ15757%27 HTTP/1.1" 200 None
2026-03-28 07:43:35 [auto1.de] INFO: Scrape type for CJ15757: 0
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: PZ40966
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ40966%27 HTTP/1.1" 200 None
2026-03-28 07:43:35 [auto1.de] INFO: Scrape type for PZ40966: 0
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: BT34315
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: ED19748
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED19748%27 HTTP/1.1" 200 None
2026-03-28 07:43:35 [auto1.de] INFO: Scrape type for ED19748: 0
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: NE16717
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: WP48150
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48150%27 HTTP/1.1" 200 None
2026-03-28 07:43:35 [auto1.de] INFO: Scrape type for WP48150: 0
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: XP82440
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: JE71066
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: MZ72792
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72792%27 HTTP/1.1" 200 None
2026-03-28 07:43:35 [auto1.de] INFO: Scrape type for MZ72792: 0
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: DH13363
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH13363%27 HTTP/1.1" 200 None
2026-03-28 07:43:35 [auto1.de] INFO: Scrape type for DH13363: 0
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: UV35373
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: YE69852
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE69852%27 HTTP/1.1" 200 None
2026-03-28 07:43:35 [auto1.de] INFO: Scrape type for YE69852: 0
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: LN88860
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: RC50586
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: SG66874
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: SG62181
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: RE51747
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: KT10840
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT10840%27 HTTP/1.1" 200 None
2026-03-28 07:43:35 [auto1.de] INFO: Scrape type for KT10840: 0
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: LV47567
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: PA97502
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA97502%27 HTTP/1.1" 200 None
2026-03-28 07:43:35 [auto1.de] INFO: Scrape type for PA97502: 0
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: ZV21910
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: GG36618
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: ZS46633
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS46633%27 HTTP/1.1" 200 None
2026-03-28 07:43:35 [auto1.de] INFO: Scrape type for ZS46633: 0
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: EZ36931
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: JC98855
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: DW94281
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW94281%27 HTTP/1.1" 200 None
2026-03-28 07:43:35 [auto1.de] INFO: Scrape type for DW94281: 0
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: ZL76152
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL76152%27 HTTP/1.1" 200 None
2026-03-28 07:43:35 [auto1.de] INFO: Scrape type for ZL76152: 0
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: XM62598
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM62598%27 HTTP/1.1" 200 None
2026-03-28 07:43:35 [auto1.de] INFO: Scrape type for XM62598: 0
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: NN41224
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: BL07705
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: LV98525
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV98525%27 HTTP/1.1" 200 None
2026-03-28 07:43:35 [auto1.de] INFO: Scrape type for LV98525: 0
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: CV89057
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV89057%27 HTTP/1.1" 200 None
2026-03-28 07:43:35 [auto1.de] INFO: Scrape type for CV89057: 0
2026-03-28 07:43:35 [auto1.de] INFO: Found listing with ID: VL85665
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL85665%27 HTTP/1.1" 200 None
2026-03-28 07:43:35 [auto1.de] INFO: Scrape type for VL85665: 0
2026-03-28 07:43:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:43:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:43:36 [auto1.de] INFO: Channel: 24h | Page: 214 | totalHits: 9266 | hits on page: 40
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: RZ99970
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: EC38320
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC38320%27 HTTP/1.1" 200 None
2026-03-28 07:43:36 [auto1.de] INFO: Scrape type for EC38320: 0
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: KK20650
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK20650%27 HTTP/1.1" 200 None
2026-03-28 07:43:36 [auto1.de] INFO: Scrape type for KK20650: 0
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: ZY62714
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY62714%27 HTTP/1.1" 200 None
2026-03-28 07:43:36 [auto1.de] INFO: Scrape type for ZY62714: 0
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: UB45914
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB45914%27 HTTP/1.1" 200 None
2026-03-28 07:43:36 [auto1.de] INFO: Scrape type for UB45914: 0
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: WL25699
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: CM72901
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM72901%27 HTTP/1.1" 200 None
2026-03-28 07:43:36 [auto1.de] INFO: Scrape type for CM72901: 0
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: FT64995
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64995%27 HTTP/1.1" 200 None
2026-03-28 07:43:36 [auto1.de] INFO: Scrape type for FT64995: 0
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: TD54604
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD54604%27 HTTP/1.1" 200 None
2026-03-28 07:43:36 [auto1.de] INFO: Scrape type for TD54604: 0
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: SY47772
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: HY54532
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: HA10430
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA10430%27 HTTP/1.1" 200 None
2026-03-28 07:43:36 [auto1.de] INFO: Scrape type for HA10430: 0
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: DJ74169
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ74169%27 HTTP/1.1" 200 None
2026-03-28 07:43:36 [auto1.de] INFO: Scrape type for DJ74169: 0
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: YJ30839
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: PS83332
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: JZ53783
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: GA26329
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA26329%27 HTTP/1.1" 200 None
2026-03-28 07:43:36 [auto1.de] INFO: Scrape type for GA26329: 0
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: JH35819
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: LD79531
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD79531%27 HTTP/1.1" 200 None
2026-03-28 07:43:36 [auto1.de] INFO: Scrape type for LD79531: 0
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: GN68043
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN68043%27 HTTP/1.1" 200 None
2026-03-28 07:43:36 [auto1.de] INFO: Scrape type for GN68043: 0
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: WA46177
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: WX41369
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX41369%27 HTTP/1.1" 200 None
2026-03-28 07:43:36 [auto1.de] INFO: Scrape type for WX41369: 0
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: BC03765
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: HN35762
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: HE96933
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE96933%27 HTTP/1.1" 200 None
2026-03-28 07:43:36 [auto1.de] INFO: Scrape type for HE96933: 0
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: XW28946
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW28946%27 HTTP/1.1" 200 None
2026-03-28 07:43:36 [auto1.de] INFO: Scrape type for XW28946: 0
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: ZC62608
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC62608%27 HTTP/1.1" 200 None
2026-03-28 07:43:36 [auto1.de] INFO: Scrape type for ZC62608: 0
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: PU35807
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU35807%27 HTTP/1.1" 200 None
2026-03-28 07:43:36 [auto1.de] INFO: Scrape type for PU35807: 0
2026-03-28 07:43:36 [auto1.de] INFO: Found listing with ID: AH71943
2026-03-28 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH71943%27 HTTP/1.1" 200 None
2026-03-28 07:43:37 [auto1.de] INFO: Scrape type for AH71943: 0
2026-03-28 07:43:37 [auto1.de] INFO: Found listing with ID: WJ12441
2026-03-28 07:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ12441%27 HTTP/1.1" 200 None
2026-03-28 07:43:37 [auto1.de] INFO: Scrape type for WJ12441: 0
2026-03-28 07:43:37 [auto1.de] INFO: Found listing with ID: HX82785
2026-03-28 07:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX82785%27 HTTP/1.1" 200 None
2026-03-28 07:43:37 [auto1.de] INFO: Scrape type for HX82785: 0
2026-03-28 07:43:37 [auto1.de] INFO: Found listing with ID: HY74574
2026-03-28 07:43:37 [auto1.de] INFO: Found listing with ID: DJ60943
2026-03-28 07:43:37 [auto1.de] INFO: Found listing with ID: YY92615
2026-03-28 07:43:37 [auto1.de] INFO: Found listing with ID: ZA19141
2026-03-28 07:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA19141%27 HTTP/1.1" 200 None
2026-03-28 07:43:37 [auto1.de] INFO: Scrape type for ZA19141: 0
2026-03-28 07:43:37 [auto1.de] INFO: Found listing with ID: BB20328
2026-03-28 07:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB20328%27 HTTP/1.1" 200 None
2026-03-28 07:43:37 [auto1.de] INFO: Scrape type for BB20328: 0
2026-03-28 07:43:37 [auto1.de] INFO: Found listing with ID: LT34656
2026-03-28 07:43:37 [auto1.de] INFO: Found listing with ID: GE94001
2026-03-28 07:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE94001%27 HTTP/1.1" 200 None
2026-03-28 07:43:37 [auto1.de] INFO: Scrape type for GE94001: 0
2026-03-28 07:43:37 [auto1.de] INFO: Found listing with ID: BA36034
2026-03-28 07:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA36034%27 HTTP/1.1" 200 None
2026-03-28 07:43:37 [auto1.de] INFO: Scrape type for BA36034: 0
2026-03-28 07:43:37 [auto1.de] INFO: Found listing with ID: RX21744
2026-03-28 07:43:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:43:38 [auto1.de] INFO: Channel: 24h | Page: 215 | totalHits: 9266 | hits on page: 40
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: DN11419
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN11419%27 HTTP/1.1" 200 None
2026-03-28 07:43:38 [auto1.de] INFO: Scrape type for DN11419: 0
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: HL77146
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL77146%27 HTTP/1.1" 200 None
2026-03-28 07:43:38 [auto1.de] INFO: Scrape type for HL77146: 0
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: RM91715
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM91715%27 HTTP/1.1" 200 None
2026-03-28 07:43:38 [auto1.de] INFO: Scrape type for RM91715: 0
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: WC14239
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: BX52940
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX52940%27 HTTP/1.1" 200 None
2026-03-28 07:43:38 [auto1.de] INFO: Scrape type for BX52940: 0
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: HA89104
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA89104%27 HTTP/1.1" 200 None
2026-03-28 07:43:38 [auto1.de] INFO: Scrape type for HA89104: 0
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: MP24640
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: KV52621
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: XB63753
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB63753%27 HTTP/1.1" 200 None
2026-03-28 07:43:38 [auto1.de] INFO: Scrape type for XB63753: 0
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: TT59921
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: FV41920
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV41920%27 HTTP/1.1" 200 None
2026-03-28 07:43:38 [auto1.de] INFO: Scrape type for FV41920: 0
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: XB43693
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB43693%27 HTTP/1.1" 200 None
2026-03-28 07:43:38 [auto1.de] INFO: Scrape type for XB43693: 0
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: SR15436
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: FG98454
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: NZ04570
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ04570%27 HTTP/1.1" 200 None
2026-03-28 07:43:38 [auto1.de] INFO: Scrape type for NZ04570: 0
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: JR30174
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR30174%27 HTTP/1.1" 200 None
2026-03-28 07:43:38 [auto1.de] INFO: Scrape type for JR30174: 0
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: LZ51858
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: EE83336
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: MK68330
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: EN87643
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: VL16221
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL16221%27 HTTP/1.1" 200 None
2026-03-28 07:43:38 [auto1.de] INFO: Scrape type for VL16221: 0
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: DL95738
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: LD21016
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD21016%27 HTTP/1.1" 200 None
2026-03-28 07:43:38 [auto1.de] INFO: Scrape type for LD21016: 0
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: WK73698
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73698%27 HTTP/1.1" 200 None
2026-03-28 07:43:38 [auto1.de] INFO: Scrape type for WK73698: 0
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: MM87204
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM87204%27 HTTP/1.1" 200 None
2026-03-28 07:43:38 [auto1.de] INFO: Scrape type for MM87204: 0
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: EE47026
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: DE85774
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE85774%27 HTTP/1.1" 200 None
2026-03-28 07:43:38 [auto1.de] INFO: Scrape type for DE85774: 0
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: GE21325
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: XG77480
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG77480%27 HTTP/1.1" 200 None
2026-03-28 07:43:38 [auto1.de] INFO: Scrape type for XG77480: 0
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: LZ09190
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ09190%27 HTTP/1.1" 200 None
2026-03-28 07:43:38 [auto1.de] INFO: Scrape type for LZ09190: 0
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: KF55313
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF55313%27 HTTP/1.1" 200 None
2026-03-28 07:43:38 [auto1.de] INFO: Scrape type for KF55313: 0
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: FH64312
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: YU55800
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU55800%27 HTTP/1.1" 200 None
2026-03-28 07:43:38 [auto1.de] INFO: Scrape type for YU55800: 0
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: MM23773
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM23773%27 HTTP/1.1" 200 None
2026-03-28 07:43:38 [auto1.de] INFO: Scrape type for MM23773: 0
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: PU00921
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: CB80286
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: DP87789
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: PE27590
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27590%27 HTTP/1.1" 200 None
2026-03-28 07:43:38 [auto1.de] INFO: Scrape type for PE27590: 0
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: PY37454
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY37454%27 HTTP/1.1" 200 None
2026-03-28 07:43:38 [auto1.de] INFO: Scrape type for PY37454: 0
2026-03-28 07:43:38 [auto1.de] INFO: Found listing with ID: XS07294
2026-03-28 07:43:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:43:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:43:39 [auto1.de] INFO: Channel: 24h | Page: 216 | totalHits: 9266 | hits on page: 40
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: ZZ72723
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: SX51992
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX51992%27 HTTP/1.1" 200 None
2026-03-28 07:43:39 [auto1.de] INFO: Scrape type for SX51992: 0
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: ZA74558
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74558%27 HTTP/1.1" 200 None
2026-03-28 07:43:39 [auto1.de] INFO: Scrape type for ZA74558: 0
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: VX77382
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX77382%27 HTTP/1.1" 200 None
2026-03-28 07:43:39 [auto1.de] INFO: Scrape type for VX77382: 0
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: KX42000
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX42000%27 HTTP/1.1" 200 None
2026-03-28 07:43:39 [auto1.de] INFO: Scrape type for KX42000: 0
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: AJ88373
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ88373%27 HTTP/1.1" 200 None
2026-03-28 07:43:39 [auto1.de] INFO: Scrape type for AJ88373: 0
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: MR65343
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: DG23349
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG23349%27 HTTP/1.1" 200 None
2026-03-28 07:43:39 [auto1.de] INFO: Scrape type for DG23349: 0
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: TG62557
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: EP44160
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: BF31444
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: DG34308
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: PL78300
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL78300%27 HTTP/1.1" 200 None
2026-03-28 07:43:39 [auto1.de] INFO: Scrape type for PL78300: 0
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: XR37106
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: XD56030
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD56030%27 HTTP/1.1" 200 None
2026-03-28 07:43:39 [auto1.de] INFO: Scrape type for XD56030: 0
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: GW52920
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: FF92976
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF92976%27 HTTP/1.1" 200 None
2026-03-28 07:43:39 [auto1.de] INFO: Scrape type for FF92976: 0
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: TP63810
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: KF41308
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: RF27065
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: MM04767
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: AJ13004
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: WG69866
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: UT93934
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: DJ80434
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: CN67479
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN67479%27 HTTP/1.1" 200 None
2026-03-28 07:43:39 [auto1.de] INFO: Scrape type for CN67479: 0
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: UJ55086
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: FH45720
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: UW00779
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW00779%27 HTTP/1.1" 200 None
2026-03-28 07:43:39 [auto1.de] INFO: Scrape type for UW00779: 0
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: FA96638
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: AK47916
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: MX66491
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: JV68298
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: BB05749
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB05749%27 HTTP/1.1" 200 None
2026-03-28 07:43:39 [auto1.de] INFO: Scrape type for BB05749: 0
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: JY05464
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: HR96195
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: ZX08266
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX08266%27 HTTP/1.1" 200 None
2026-03-28 07:43:39 [auto1.de] INFO: Scrape type for ZX08266: 0
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: BZ75769
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: BN23533
2026-03-28 07:43:39 [auto1.de] INFO: Found listing with ID: KL73476
2026-03-28 07:43:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:43:41 [auto1.de] INFO: Channel: 24h | Page: 217 | totalHits: 9266 | hits on page: 40
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: UF45337
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: LK12001
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK12001%27 HTTP/1.1" 200 None
2026-03-28 07:43:41 [auto1.de] INFO: Scrape type for LK12001: 0
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: AL51386
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL51386%27 HTTP/1.1" 200 None
2026-03-28 07:43:41 [auto1.de] INFO: Scrape type for AL51386: 0
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: FV26342
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV26342%27 HTTP/1.1" 200 None
2026-03-28 07:43:41 [auto1.de] INFO: Scrape type for FV26342: 0
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: PK01210
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK01210%27 HTTP/1.1" 200 None
2026-03-28 07:43:41 [auto1.de] INFO: Scrape type for PK01210: 0
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: DB09685
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: BW77657
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW77657%27 HTTP/1.1" 200 None
2026-03-28 07:43:41 [auto1.de] INFO: Scrape type for BW77657: 0
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: BL84965
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL84965%27 HTTP/1.1" 200 None
2026-03-28 07:43:41 [auto1.de] INFO: Scrape type for BL84965: 0
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: ML06015
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML06015%27 HTTP/1.1" 200 None
2026-03-28 07:43:41 [auto1.de] INFO: Scrape type for ML06015: 0
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: NR72053
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR72053%27 HTTP/1.1" 200 None
2026-03-28 07:43:41 [auto1.de] INFO: Scrape type for NR72053: 0
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: DA75557
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: RH12349
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: JJ83769
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: EW68189
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: NN07588
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN07588%27 HTTP/1.1" 200 None
2026-03-28 07:43:41 [auto1.de] INFO: Scrape type for NN07588: 0
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: NA20314
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: BD98070
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD98070%27 HTTP/1.1" 200 None
2026-03-28 07:43:41 [auto1.de] INFO: Scrape type for BD98070: 0
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: JV29717
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: DG61616
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: SA96746
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: YU15721
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: EL73218
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL73218%27 HTTP/1.1" 200 None
2026-03-28 07:43:41 [auto1.de] INFO: Scrape type for EL73218: 0
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: BR95231
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR95231%27 HTTP/1.1" 200 None
2026-03-28 07:43:41 [auto1.de] INFO: Scrape type for BR95231: 0
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: JX40120
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX40120%27 HTTP/1.1" 200 None
2026-03-28 07:43:41 [auto1.de] INFO: Scrape type for JX40120: 0
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: TX40728
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: UG67799
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: SJ84971
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: HA98136
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: GC03067
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC03067%27 HTTP/1.1" 200 None
2026-03-28 07:43:41 [auto1.de] INFO: Scrape type for GC03067: 0
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: NZ72675
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: TY32384
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: KG20268
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: XW85438
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW85438%27 HTTP/1.1" 200 None
2026-03-28 07:43:41 [auto1.de] INFO: Scrape type for XW85438: 0
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: AT56964
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT56964%27 HTTP/1.1" 200 None
2026-03-28 07:43:41 [auto1.de] INFO: Scrape type for AT56964: 0
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: LL81874
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: RF75953
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: DD09602
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: SD97689
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97689%27 HTTP/1.1" 200 None
2026-03-28 07:43:41 [auto1.de] INFO: Scrape type for SD97689: 0
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: PN78353
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN78353%27 HTTP/1.1" 200 None
2026-03-28 07:43:41 [auto1.de] INFO: Scrape type for PN78353: 0
2026-03-28 07:43:41 [auto1.de] INFO: Found listing with ID: EV07676
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV07676%27 HTTP/1.1" 200 None
2026-03-28 07:43:41 [auto1.de] INFO: Scrape type for EV07676: 0
2026-03-28 07:43:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:43:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:43:42 [auto1.de] INFO: Channel: 24h | Page: 218 | totalHits: 9266 | hits on page: 40
2026-03-28 07:43:42 [auto1.de] INFO: Found listing with ID: YV35353
2026-03-28 07:43:42 [auto1.de] INFO: Found listing with ID: RY40991
2026-03-28 07:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY40991%27 HTTP/1.1" 200 None
2026-03-28 07:43:42 [auto1.de] INFO: Scrape type for RY40991: 0
2026-03-28 07:43:42 [auto1.de] INFO: Found listing with ID: TB03124
2026-03-28 07:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB03124%27 HTTP/1.1" 200 None
2026-03-28 07:43:42 [auto1.de] INFO: Scrape type for TB03124: 0
2026-03-28 07:43:42 [auto1.de] INFO: Found listing with ID: NG37948
2026-03-28 07:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG37948%27 HTTP/1.1" 200 None
2026-03-28 07:43:42 [auto1.de] INFO: Scrape type for NG37948: 0
2026-03-28 07:43:42 [auto1.de] INFO: Found listing with ID: YH81029
2026-03-28 07:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH81029%27 HTTP/1.1" 200 None
2026-03-28 07:43:42 [auto1.de] INFO: Scrape type for YH81029: 0
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: ML35786
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: JG82377
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG82377%27 HTTP/1.1" 200 None
2026-03-28 07:43:43 [auto1.de] INFO: Scrape type for JG82377: 0
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: XJ97474
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: DG85302
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: LF15442
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF15442%27 HTTP/1.1" 200 None
2026-03-28 07:43:43 [auto1.de] INFO: Scrape type for LF15442: 0
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: WG70910
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG70910%27 HTTP/1.1" 200 None
2026-03-28 07:43:43 [auto1.de] INFO: Scrape type for WG70910: 0
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: XY91338
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: ZH54779
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH54779%27 HTTP/1.1" 200 None
2026-03-28 07:43:43 [auto1.de] INFO: Scrape type for ZH54779: 0
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: GE03555
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE03555%27 HTTP/1.1" 200 None
2026-03-28 07:43:43 [auto1.de] INFO: Scrape type for GE03555: 0
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: YY49162
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY49162%27 HTTP/1.1" 200 None
2026-03-28 07:43:43 [auto1.de] INFO: Scrape type for YY49162: 0
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: HT64251
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT64251%27 HTTP/1.1" 200 None
2026-03-28 07:43:43 [auto1.de] INFO: Scrape type for HT64251: 0
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: TX92660
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: JL85877
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL85877%27 HTTP/1.1" 200 None
2026-03-28 07:43:43 [auto1.de] INFO: Scrape type for JL85877: 0
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: EC36203
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC36203%27 HTTP/1.1" 200 None
2026-03-28 07:43:43 [auto1.de] INFO: Scrape type for EC36203: 0
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: PZ33404
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: LL15014
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: ZU03053
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: JC56914
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC56914%27 HTTP/1.1" 200 None
2026-03-28 07:43:43 [auto1.de] INFO: Scrape type for JC56914: 0
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: VK31305
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: LU78971
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU78971%27 HTTP/1.1" 200 None
2026-03-28 07:43:43 [auto1.de] INFO: Scrape type for LU78971: 0
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: PW95662
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW95662%27 HTTP/1.1" 200 None
2026-03-28 07:43:43 [auto1.de] INFO: Scrape type for PW95662: 0
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: MW62166
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW62166%27 HTTP/1.1" 200 None
2026-03-28 07:43:43 [auto1.de] INFO: Scrape type for MW62166: 0
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: XU56450
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: EV99140
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV99140%27 HTTP/1.1" 200 None
2026-03-28 07:43:43 [auto1.de] INFO: Scrape type for EV99140: 0
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: BP82527
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP82527%27 HTTP/1.1" 200 None
2026-03-28 07:43:43 [auto1.de] INFO: Scrape type for BP82527: 0
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: CA11296
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA11296%27 HTTP/1.1" 200 None
2026-03-28 07:43:43 [auto1.de] INFO: Scrape type for CA11296: 0
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: BC73225
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: LP67164
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP67164%27 HTTP/1.1" 200 None
2026-03-28 07:43:43 [auto1.de] INFO: Scrape type for LP67164: 0
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: LT72401
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT72401%27 HTTP/1.1" 200 None
2026-03-28 07:43:43 [auto1.de] INFO: Scrape type for LT72401: 0
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: JV37620
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV37620%27 HTTP/1.1" 200 None
2026-03-28 07:43:43 [auto1.de] INFO: Scrape type for JV37620: 0
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: WA42896
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: LA05422
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA05422%27 HTTP/1.1" 200 None
2026-03-28 07:43:43 [auto1.de] INFO: Scrape type for LA05422: 0
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: EG39576
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: XN26192
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26192%27 HTTP/1.1" 200 None
2026-03-28 07:43:43 [auto1.de] INFO: Scrape type for XN26192: 0
2026-03-28 07:43:43 [auto1.de] INFO: Found listing with ID: TJ09014
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ09014%27 HTTP/1.1" 200 None
2026-03-28 07:43:43 [auto1.de] INFO: Scrape type for TJ09014: 0
2026-03-28 07:43:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:43:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:43:44 [auto1.de] INFO: Channel: 24h | Page: 219 | totalHits: 9266 | hits on page: 40
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: NX72393
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX72393%27 HTTP/1.1" 200 None
2026-03-28 07:43:44 [auto1.de] INFO: Scrape type for NX72393: 0
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: WP15063
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: UE87725
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: KV75239
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV75239%27 HTTP/1.1" 200 None
2026-03-28 07:43:44 [auto1.de] INFO: Scrape type for KV75239: 0
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: SV37503
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV37503%27 HTTP/1.1" 200 None
2026-03-28 07:43:44 [auto1.de] INFO: Scrape type for SV37503: 0
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: XG51341
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG51341%27 HTTP/1.1" 200 None
2026-03-28 07:43:44 [auto1.de] INFO: Scrape type for XG51341: 0
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: EU55937
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU55937%27 HTTP/1.1" 200 None
2026-03-28 07:43:44 [auto1.de] INFO: Scrape type for EU55937: 0
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: BD92511
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: VC64340
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: BF85943
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF85943%27 HTTP/1.1" 200 None
2026-03-28 07:43:44 [auto1.de] INFO: Scrape type for BF85943: 0
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: NS04983
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS04983%27 HTTP/1.1" 200 None
2026-03-28 07:43:44 [auto1.de] INFO: Scrape type for NS04983: 0
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: BB57132
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: AV32823
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: AR39544
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: UC84662
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: TE93454
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: GH47357
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH47357%27 HTTP/1.1" 200 None
2026-03-28 07:43:44 [auto1.de] INFO: Scrape type for GH47357: 0
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: CA65369
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA65369%27 HTTP/1.1" 200 None
2026-03-28 07:43:44 [auto1.de] INFO: Scrape type for CA65369: 0
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: ZR21062
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: BD43064
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD43064%27 HTTP/1.1" 200 None
2026-03-28 07:43:44 [auto1.de] INFO: Scrape type for BD43064: 0
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: UF29194
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF29194%27 HTTP/1.1" 200 None
2026-03-28 07:43:44 [auto1.de] INFO: Scrape type for UF29194: 0
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: KY14800
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: UK28152
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: RV94916
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: GV91786
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91786%27 HTTP/1.1" 200 None
2026-03-28 07:43:44 [auto1.de] INFO: Scrape type for GV91786: 0
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: UZ90215
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: TN59671
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN59671%27 HTTP/1.1" 200 None
2026-03-28 07:43:44 [auto1.de] INFO: Scrape type for TN59671: 0
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: CZ08846
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: RW84791
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: EJ47665
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: GK53222
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK53222%27 HTTP/1.1" 200 None
2026-03-28 07:43:44 [auto1.de] INFO: Scrape type for GK53222: 0
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: GK41748
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK41748%27 HTTP/1.1" 200 None
2026-03-28 07:43:44 [auto1.de] INFO: Scrape type for GK41748: 0
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: DM49539
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: UH91436
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: LB73186
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB73186%27 HTTP/1.1" 200 None
2026-03-28 07:43:44 [auto1.de] INFO: Scrape type for LB73186: 0
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: WE65713
2026-03-28 07:43:44 [auto1.de] INFO: Found listing with ID: NC65519
2026-03-28 07:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC65519%27 HTTP/1.1" 200 None
2026-03-28 07:43:45 [auto1.de] INFO: Scrape type for NC65519: 0
2026-03-28 07:43:45 [auto1.de] INFO: Found listing with ID: ZY93547
2026-03-28 07:43:45 [auto1.de] INFO: Found listing with ID: YH44643
2026-03-28 07:43:45 [auto1.de] INFO: Found listing with ID: WB73740
2026-03-28 07:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB73740%27 HTTP/1.1" 200 None
2026-03-28 07:43:45 [auto1.de] INFO: Scrape type for WB73740: 0
2026-03-28 07:43:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:43:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:43:46 [auto1.de] INFO: Channel: 24h | Page: 220 | totalHits: 9266 | hits on page: 40
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: FS06029
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: CN87800
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN87800%27 HTTP/1.1" 200 None
2026-03-28 07:43:46 [auto1.de] INFO: Scrape type for CN87800: 0
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: UB65858
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: TH26087
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: NF34057
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF34057%27 HTTP/1.1" 200 None
2026-03-28 07:43:46 [auto1.de] INFO: Scrape type for NF34057: 0
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: AW17852
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW17852%27 HTTP/1.1" 200 None
2026-03-28 07:43:46 [auto1.de] INFO: Scrape type for AW17852: 0
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: BM76815
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: WU91677
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: ZK30866
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK30866%27 HTTP/1.1" 200 None
2026-03-28 07:43:46 [auto1.de] INFO: Scrape type for ZK30866: 0
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: WF94997
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: YS21206
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS21206%27 HTTP/1.1" 200 None
2026-03-28 07:43:46 [auto1.de] INFO: Scrape type for YS21206: 0
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: ZY07029
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: ZN72039
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: BU23510
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: VC63070
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC63070%27 HTTP/1.1" 200 None
2026-03-28 07:43:46 [auto1.de] INFO: Scrape type for VC63070: 0
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: RS52465
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52465%27 HTTP/1.1" 200 None
2026-03-28 07:43:46 [auto1.de] INFO: Scrape type for RS52465: 0
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: ME69590
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME69590%27 HTTP/1.1" 200 None
2026-03-28 07:43:46 [auto1.de] INFO: Scrape type for ME69590: 0
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: FK93583
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93583%27 HTTP/1.1" 200 None
2026-03-28 07:43:46 [auto1.de] INFO: Scrape type for FK93583: 0
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: YF25460
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF25460%27 HTTP/1.1" 200 None
2026-03-28 07:43:46 [auto1.de] INFO: Scrape type for YF25460: 0
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: NM28513
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM28513%27 HTTP/1.1" 200 None
2026-03-28 07:43:46 [auto1.de] INFO: Scrape type for NM28513: 0
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: JP08522
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: YT48598
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT48598%27 HTTP/1.1" 200 None
2026-03-28 07:43:46 [auto1.de] INFO: Scrape type for YT48598: 0
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: HD52891
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: XY70185
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY70185%27 HTTP/1.1" 200 None
2026-03-28 07:43:46 [auto1.de] INFO: Scrape type for XY70185: 0
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: ZN44804
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: YW59624
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW59624%27 HTTP/1.1" 200 None
2026-03-28 07:43:46 [auto1.de] INFO: Scrape type for YW59624: 0
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: RG82987
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG82987%27 HTTP/1.1" 200 None
2026-03-28 07:43:46 [auto1.de] INFO: Scrape type for RG82987: 0
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: MG28857
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG28857%27 HTTP/1.1" 200 None
2026-03-28 07:43:46 [auto1.de] INFO: Scrape type for MG28857: 0
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: JT86021
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT86021%27 HTTP/1.1" 200 None
2026-03-28 07:43:46 [auto1.de] INFO: Scrape type for JT86021: 0
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: SB93381
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: JV68869
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: FS76993
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: PL48246
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL48246%27 HTTP/1.1" 200 None
2026-03-28 07:43:46 [auto1.de] INFO: Scrape type for PL48246: 0
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: KY06770
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: LC91854
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91854%27 HTTP/1.1" 200 None
2026-03-28 07:43:46 [auto1.de] INFO: Scrape type for LC91854: 0
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: ZF67159
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF67159%27 HTTP/1.1" 200 None
2026-03-28 07:43:46 [auto1.de] INFO: Scrape type for ZF67159: 0
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: PL89727
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL89727%27 HTTP/1.1" 200 None
2026-03-28 07:43:46 [auto1.de] INFO: Scrape type for PL89727: 0
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: LK50983
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK50983%27 HTTP/1.1" 200 None
2026-03-28 07:43:46 [auto1.de] INFO: Scrape type for LK50983: 0
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: VW42745
2026-03-28 07:43:46 [auto1.de] INFO: Found listing with ID: CD81555
2026-03-28 07:43:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:43:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:43:47 [auto1.de] INFO: Channel: 24h | Page: 221 | totalHits: 9266 | hits on page: 40
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: SW77788
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: HR27692
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: EF84485
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF84485%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for EF84485: 0
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: SP58738
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP58738%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for SP58738: 0
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: TZ19731
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ19731%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for TZ19731: 0
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: VW82123
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW82123%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for VW82123: 0
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: JN93492
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: KG12536
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: VE70317
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: XZ35475
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: XZ46710
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: UH14154
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: RP50374
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP50374%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for RP50374: 0
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: XD11713
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD11713%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for XD11713: 0
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: MW91304
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: TE25882
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: WD55568
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD55568%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for WD55568: 0
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: NV33173
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV33173%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for NV33173: 0
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: YT60499
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT60499%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for YT60499: 0
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: HS55483
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55483%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for HS55483: 0
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: XE26333
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE26333%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for XE26333: 0
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: JL71783
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: FZ40219
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ40219%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for FZ40219: 0
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: UG93766
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: GM47642
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM47642%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for GM47642: 0
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: FM56481
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM56481%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for FM56481: 0
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: GG14507
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG14507%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for GG14507: 0
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: RV05301
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV05301%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for RV05301: 0
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: MY83778
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY83778%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for MY83778: 0
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: TL69510
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL69510%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for TL69510: 0
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: WW79477
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW79477%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for WW79477: 0
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: PX08843
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: YA95886
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA95886%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for YA95886: 0
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: VS86742
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS86742%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for VS86742: 0
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: BN16879
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN16879%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for BN16879: 0
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: ZG28999
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: JS31219
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS31219%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for JS31219: 0
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: CC89680
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89680%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for CC89680: 0
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: RD48040
2026-03-28 07:43:47 [auto1.de] INFO: Found listing with ID: BR76788
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR76788%27 HTTP/1.1" 200 None
2026-03-28 07:43:47 [auto1.de] INFO: Scrape type for BR76788: 0
2026-03-28 07:43:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:43:49 [auto1.de] INFO: Channel: 24h | Page: 222 | totalHits: 9266 | hits on page: 40
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: CG27437
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG27437%27 HTTP/1.1" 200 None
2026-03-28 07:43:49 [auto1.de] INFO: Scrape type for CG27437: 0
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: JH55559
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: BK33721
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK33721%27 HTTP/1.1" 200 None
2026-03-28 07:43:49 [auto1.de] INFO: Scrape type for BK33721: 0
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: RY91150
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: DV93424
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: UA99950
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: NT60185
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT60185%27 HTTP/1.1" 200 None
2026-03-28 07:43:49 [auto1.de] INFO: Scrape type for NT60185: 0
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: NY07773
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY07773%27 HTTP/1.1" 200 None
2026-03-28 07:43:49 [auto1.de] INFO: Scrape type for NY07773: 0
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: DJ76178
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: UT22988
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: SF51688
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: EB92999
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB92999%27 HTTP/1.1" 200 None
2026-03-28 07:43:49 [auto1.de] INFO: Scrape type for EB92999: 0
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: GN10929
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: VH64157
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: XJ26035
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ26035%27 HTTP/1.1" 200 None
2026-03-28 07:43:49 [auto1.de] INFO: Scrape type for XJ26035: 0
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: KL53261
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL53261%27 HTTP/1.1" 200 None
2026-03-28 07:43:49 [auto1.de] INFO: Scrape type for KL53261: 0
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: GA31653
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: NP49973
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: GR11096
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: EU72034
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU72034%27 HTTP/1.1" 200 None
2026-03-28 07:43:49 [auto1.de] INFO: Scrape type for EU72034: 0
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: CP54704
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: UX71045
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX71045%27 HTTP/1.1" 200 None
2026-03-28 07:43:49 [auto1.de] INFO: Scrape type for UX71045: 0
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: NC35007
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC35007%27 HTTP/1.1" 200 None
2026-03-28 07:43:49 [auto1.de] INFO: Scrape type for NC35007: 0
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: JU59461
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: FB31140
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB31140%27 HTTP/1.1" 200 None
2026-03-28 07:43:49 [auto1.de] INFO: Scrape type for FB31140: 0
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: YS81277
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS81277%27 HTTP/1.1" 200 None
2026-03-28 07:43:49 [auto1.de] INFO: Scrape type for YS81277: 0
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: AH29152
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: YY76457
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: BA73417
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA73417%27 HTTP/1.1" 200 None
2026-03-28 07:43:49 [auto1.de] INFO: Scrape type for BA73417: 0
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: FM08350
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: TB15164
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: DF02739
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF02739%27 HTTP/1.1" 200 None
2026-03-28 07:43:49 [auto1.de] INFO: Scrape type for DF02739: 0
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: JF95451
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF95451%27 HTTP/1.1" 200 None
2026-03-28 07:43:49 [auto1.de] INFO: Scrape type for JF95451: 0
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: ZT19745
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT19745%27 HTTP/1.1" 200 None
2026-03-28 07:43:49 [auto1.de] INFO: Scrape type for ZT19745: 0
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: YE46941
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE46941%27 HTTP/1.1" 200 None
2026-03-28 07:43:49 [auto1.de] INFO: Scrape type for YE46941: 0
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: JG77097
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: FZ02201
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: CJ75518
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: UM10671
2026-03-28 07:43:49 [auto1.de] INFO: Found listing with ID: TE39343
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE39343%27 HTTP/1.1" 200 None
2026-03-28 07:43:49 [auto1.de] INFO: Scrape type for TE39343: 0
2026-03-28 07:43:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:43:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:43:50 [auto1.de] INFO: Channel: 24h | Page: 223 | totalHits: 9266 | hits on page: 40
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: KH46132
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH46132%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for KH46132: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: US92808
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US92808%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for US92808: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: AB79504
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB79504%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for AB79504: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: ZM88975
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88975%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for ZM88975: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: TJ16115
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ16115%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for TJ16115: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: RS52276
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52276%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for RS52276: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: GN84809
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN84809%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for GN84809: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: DX61886
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX61886%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for DX61886: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: AK65785
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK65785%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for AK65785: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: BU48960
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: NX83651
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: AK97582
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK97582%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for AK97582: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: GE73392
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE73392%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for GE73392: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: DG35961
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: PE88968
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: EJ25575
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ25575%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for EJ25575: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: WJ93096
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ93096%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for WJ93096: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: PE74408
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE74408%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for PE74408: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: UY58997
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY58997%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for UY58997: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: GG04913
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG04913%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for GG04913: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: BH52991
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: ZS47676
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS47676%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for ZS47676: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: JL44277
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL44277%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for JL44277: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: DM95893
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: XD89320
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: KB62018
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB62018%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for KB62018: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: EG39650
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39650%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for EG39650: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: ZV64166
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV64166%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for ZV64166: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: EC93517
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC93517%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for EC93517: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: XR69964
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: HD14897
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD14897%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for HD14897: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: BK94674
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK94674%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for BK94674: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: WP47747
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP47747%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for WP47747: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: CA38480
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: ZZ79893
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ79893%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for ZZ79893: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: AR19685
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: HK54486
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK54486%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for HK54486: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: CU93791
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU93791%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for CU93791: 0
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: LR85001
2026-03-28 07:43:50 [auto1.de] INFO: Found listing with ID: XD58993
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD58993%27 HTTP/1.1" 200 None
2026-03-28 07:43:50 [auto1.de] INFO: Scrape type for XD58993: 0
2026-03-28 07:43:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:43:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:43:51 [auto1.de] INFO: Channel: 24h | Page: 224 | totalHits: 9266 | hits on page: 40
2026-03-28 07:43:51 [auto1.de] INFO: Found listing with ID: NA39997
2026-03-28 07:43:51 [auto1.de] INFO: Found listing with ID: PK38056
2026-03-28 07:43:51 [auto1.de] INFO: Found listing with ID: KK51592
2026-03-28 07:43:51 [auto1.de] INFO: Found listing with ID: PA88457
2026-03-28 07:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA88457%27 HTTP/1.1" 200 None
2026-03-28 07:43:51 [auto1.de] INFO: Scrape type for PA88457: 0
2026-03-28 07:43:51 [auto1.de] INFO: Found listing with ID: RC78323
2026-03-28 07:43:51 [auto1.de] INFO: Found listing with ID: EN47046
2026-03-28 07:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN47046%27 HTTP/1.1" 200 None
2026-03-28 07:43:51 [auto1.de] INFO: Scrape type for EN47046: 0
2026-03-28 07:43:51 [auto1.de] INFO: Found listing with ID: VB96558
2026-03-28 07:43:51 [auto1.de] INFO: Found listing with ID: XA05617
2026-03-28 07:43:51 [auto1.de] INFO: Found listing with ID: XC54847
2026-03-28 07:43:51 [auto1.de] INFO: Found listing with ID: DF63833
2026-03-28 07:43:51 [auto1.de] INFO: Found listing with ID: YJ19270
2026-03-28 07:43:51 [auto1.de] INFO: Found listing with ID: MS86460
2026-03-28 07:43:51 [auto1.de] INFO: Found listing with ID: ZU48886
2026-03-28 07:43:51 [auto1.de] INFO: Found listing with ID: NC07165
2026-03-28 07:43:51 [auto1.de] INFO: Found listing with ID: NU47228
2026-03-28 07:43:51 [auto1.de] INFO: Found listing with ID: FA01437
2026-03-28 07:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA01437%27 HTTP/1.1" 200 None
2026-03-28 07:43:51 [auto1.de] INFO: Scrape type for FA01437: 0
2026-03-28 07:43:51 [auto1.de] INFO: Found listing with ID: XL62342
2026-03-28 07:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL62342%27 HTTP/1.1" 200 None
2026-03-28 07:43:51 [auto1.de] INFO: Scrape type for XL62342: 0
2026-03-28 07:43:51 [auto1.de] INFO: Found listing with ID: YW30878
2026-03-28 07:43:51 [auto1.de] INFO: Found listing with ID: WS30363
2026-03-28 07:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS30363%27 HTTP/1.1" 200 None
2026-03-28 07:43:52 [auto1.de] INFO: Scrape type for WS30363: 0
2026-03-28 07:43:52 [auto1.de] INFO: Found listing with ID: PF96299
2026-03-28 07:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF96299%27 HTTP/1.1" 200 None
2026-03-28 07:43:52 [auto1.de] INFO: Scrape type for PF96299: 0
2026-03-28 07:43:52 [auto1.de] INFO: Found listing with ID: KV22200
2026-03-28 07:43:52 [auto1.de] INFO: Found listing with ID: MS46414
2026-03-28 07:43:52 [auto1.de] INFO: Found listing with ID: JV32404
2026-03-28 07:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV32404%27 HTTP/1.1" 200 None
2026-03-28 07:43:52 [auto1.de] INFO: Scrape type for JV32404: 0
2026-03-28 07:43:52 [auto1.de] INFO: Found listing with ID: LT68556
2026-03-28 07:43:52 [auto1.de] INFO: Found listing with ID: KF96010
2026-03-28 07:43:52 [auto1.de] INFO: Found listing with ID: GF62239
2026-03-28 07:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF62239%27 HTTP/1.1" 200 None
2026-03-28 07:43:52 [auto1.de] INFO: Scrape type for GF62239: 0
2026-03-28 07:43:52 [auto1.de] INFO: Found listing with ID: CC75051
2026-03-28 07:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC75051%27 HTTP/1.1" 200 None
2026-03-28 07:43:52 [auto1.de] INFO: Scrape type for CC75051: 0
2026-03-28 07:43:52 [auto1.de] INFO: Found listing with ID: AJ85569
2026-03-28 07:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ85569%27 HTTP/1.1" 200 None
2026-03-28 07:43:52 [auto1.de] INFO: Scrape type for AJ85569: 0
2026-03-28 07:43:52 [auto1.de] INFO: Found listing with ID: DC90555
2026-03-28 07:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC90555%27 HTTP/1.1" 200 None
2026-03-28 07:43:52 [auto1.de] INFO: Scrape type for DC90555: 0
2026-03-28 07:43:52 [auto1.de] INFO: Found listing with ID: YF42870
2026-03-28 07:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF42870%27 HTTP/1.1" 200 None
2026-03-28 07:43:52 [auto1.de] INFO: Scrape type for YF42870: 0
2026-03-28 07:43:52 [auto1.de] INFO: Found listing with ID: DZ79939
2026-03-28 07:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ79939%27 HTTP/1.1" 200 None
2026-03-28 07:43:52 [auto1.de] INFO: Scrape type for DZ79939: 0
2026-03-28 07:43:52 [auto1.de] INFO: Found listing with ID: PW65541
2026-03-28 07:43:52 [auto1.de] INFO: Found listing with ID: ND02727
2026-03-28 07:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND02727%27 HTTP/1.1" 200 None
2026-03-28 07:43:52 [auto1.de] INFO: Scrape type for ND02727: 0
2026-03-28 07:43:52 [auto1.de] INFO: Found listing with ID: JU04620
2026-03-28 07:43:52 [auto1.de] INFO: Found listing with ID: TE97467
2026-03-28 07:43:52 [auto1.de] INFO: Found listing with ID: VW56389
2026-03-28 07:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW56389%27 HTTP/1.1" 200 None
2026-03-28 07:43:52 [auto1.de] INFO: Scrape type for VW56389: 0
2026-03-28 07:43:52 [auto1.de] INFO: Found listing with ID: NR64586
2026-03-28 07:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR64586%27 HTTP/1.1" 200 None
2026-03-28 07:43:52 [auto1.de] INFO: Scrape type for NR64586: 0
2026-03-28 07:43:52 [auto1.de] INFO: Found listing with ID: CE61200
2026-03-28 07:43:52 [auto1.de] INFO: Found listing with ID: AE19293
2026-03-28 07:43:52 [auto1.de] INFO: Found listing with ID: PS95073
2026-03-28 07:43:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:43:53 [auto1.de] INFO: Channel: 24h | Page: 225 | totalHits: 9266 | hits on page: 40
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: FV21429
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: PW98263
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: KR34750
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR34750%27 HTTP/1.1" 200 None
2026-03-28 07:43:53 [auto1.de] INFO: Scrape type for KR34750: 0
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: UF21072
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF21072%27 HTTP/1.1" 200 None
2026-03-28 07:43:53 [auto1.de] INFO: Scrape type for UF21072: 0
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: PB99961
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB99961%27 HTTP/1.1" 200 None
2026-03-28 07:43:53 [auto1.de] INFO: Scrape type for PB99961: 0
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: DL69348
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: ZZ71304
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: ZM08692
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM08692%27 HTTP/1.1" 200 None
2026-03-28 07:43:53 [auto1.de] INFO: Scrape type for ZM08692: 0
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: US46384
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US46384%27 HTTP/1.1" 200 None
2026-03-28 07:43:53 [auto1.de] INFO: Scrape type for US46384: 0
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: ZR48762
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: MM29891
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: ZD02189
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD02189%27 HTTP/1.1" 200 None
2026-03-28 07:43:53 [auto1.de] INFO: Scrape type for ZD02189: 0
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: VY61993
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY61993%27 HTTP/1.1" 200 None
2026-03-28 07:43:53 [auto1.de] INFO: Scrape type for VY61993: 0
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: BP02747
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP02747%27 HTTP/1.1" 200 None
2026-03-28 07:43:53 [auto1.de] INFO: Scrape type for BP02747: 0
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: AN93893
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN93893%27 HTTP/1.1" 200 None
2026-03-28 07:43:53 [auto1.de] INFO: Scrape type for AN93893: 0
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: AX34994
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: LC37503
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC37503%27 HTTP/1.1" 200 None
2026-03-28 07:43:53 [auto1.de] INFO: Scrape type for LC37503: 0
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: MG63340
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG63340%27 HTTP/1.1" 200 None
2026-03-28 07:43:53 [auto1.de] INFO: Scrape type for MG63340: 0
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: PZ17668
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: MY79904
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: SK36887
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: AY58726
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY58726%27 HTTP/1.1" 200 None
2026-03-28 07:43:53 [auto1.de] INFO: Scrape type for AY58726: 0
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: FX88340
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX88340%27 HTTP/1.1" 200 None
2026-03-28 07:43:53 [auto1.de] INFO: Scrape type for FX88340: 0
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: SX14499
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: YH93335
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH93335%27 HTTP/1.1" 200 None
2026-03-28 07:43:53 [auto1.de] INFO: Scrape type for YH93335: 0
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: EF65370
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: AH95980
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH95980%27 HTTP/1.1" 200 None
2026-03-28 07:43:53 [auto1.de] INFO: Scrape type for AH95980: 0
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: MH69826
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: WF31302
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF31302%27 HTTP/1.1" 200 None
2026-03-28 07:43:53 [auto1.de] INFO: Scrape type for WF31302: 0
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: AR05539
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR05539%27 HTTP/1.1" 200 None
2026-03-28 07:43:53 [auto1.de] INFO: Scrape type for AR05539: 0
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: ER51805
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: TW44182
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: YM46431
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM46431%27 HTTP/1.1" 200 None
2026-03-28 07:43:53 [auto1.de] INFO: Scrape type for YM46431: 0
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: KP72135
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: RN03307
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN03307%27 HTTP/1.1" 200 None
2026-03-28 07:43:53 [auto1.de] INFO: Scrape type for RN03307: 0
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: UK53846
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: PG30420
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG30420%27 HTTP/1.1" 200 None
2026-03-28 07:43:53 [auto1.de] INFO: Scrape type for PG30420: 0
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: NZ32972
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ32972%27 HTTP/1.1" 200 None
2026-03-28 07:43:53 [auto1.de] INFO: Scrape type for NZ32972: 0
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: TH91647
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH91647%27 HTTP/1.1" 200 None
2026-03-28 07:43:53 [auto1.de] INFO: Scrape type for TH91647: 0
2026-03-28 07:43:53 [auto1.de] INFO: Found listing with ID: MF45027
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF45027%27 HTTP/1.1" 200 None
2026-03-28 07:43:53 [auto1.de] INFO: Scrape type for MF45027: 0
2026-03-28 07:43:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:43:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:43:54 [auto1.de] INFO: Channel: 24h | Page: 226 | totalHits: 9266 | hits on page: 40
2026-03-28 07:43:54 [auto1.de] INFO: Found listing with ID: MY29921
2026-03-28 07:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY29921%27 HTTP/1.1" 200 None
2026-03-28 07:43:54 [auto1.de] INFO: Scrape type for MY29921: 0
2026-03-28 07:43:54 [auto1.de] INFO: Found listing with ID: FB84476
2026-03-28 07:43:54 [auto1.de] INFO: Found listing with ID: ST57334
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST57334%27 HTTP/1.1" 200 None
2026-03-28 07:43:55 [auto1.de] INFO: Scrape type for ST57334: 0
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: FS00408
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: KM30220
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: ZM90265
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM90265%27 HTTP/1.1" 200 None
2026-03-28 07:43:55 [auto1.de] INFO: Scrape type for ZM90265: 0
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: YS55163
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: YM28187
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM28187%27 HTTP/1.1" 200 None
2026-03-28 07:43:55 [auto1.de] INFO: Scrape type for YM28187: 0
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: XU02017
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: UD14847
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD14847%27 HTTP/1.1" 200 None
2026-03-28 07:43:55 [auto1.de] INFO: Scrape type for UD14847: 0
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: PA85998
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA85998%27 HTTP/1.1" 200 None
2026-03-28 07:43:55 [auto1.de] INFO: Scrape type for PA85998: 0
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: VX06464
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06464%27 HTTP/1.1" 200 None
2026-03-28 07:43:55 [auto1.de] INFO: Scrape type for VX06464: 0
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: PV05136
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: EC48687
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC48687%27 HTTP/1.1" 200 None
2026-03-28 07:43:55 [auto1.de] INFO: Scrape type for EC48687: 0
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: VC27283
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC27283%27 HTTP/1.1" 200 None
2026-03-28 07:43:55 [auto1.de] INFO: Scrape type for VC27283: 0
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: KR59987
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR59987%27 HTTP/1.1" 200 None
2026-03-28 07:43:55 [auto1.de] INFO: Scrape type for KR59987: 0
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: RN45636
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: BX38798
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX38798%27 HTTP/1.1" 200 None
2026-03-28 07:43:55 [auto1.de] INFO: Scrape type for BX38798: 0
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: XG58500
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: AE20511
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: RT05682
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT05682%27 HTTP/1.1" 200 None
2026-03-28 07:43:55 [auto1.de] INFO: Scrape type for RT05682: 0
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: EM07898
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: ZK76499
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: NB76223
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: VD78060
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: AH76263
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: EN46705
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN46705%27 HTTP/1.1" 200 None
2026-03-28 07:43:55 [auto1.de] INFO: Scrape type for EN46705: 0
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: JZ27200
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: FZ50846
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ50846%27 HTTP/1.1" 200 None
2026-03-28 07:43:55 [auto1.de] INFO: Scrape type for FZ50846: 0
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: ZS04919
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS04919%27 HTTP/1.1" 200 None
2026-03-28 07:43:55 [auto1.de] INFO: Scrape type for ZS04919: 0
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: RM03411
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM03411%27 HTTP/1.1" 200 None
2026-03-28 07:43:55 [auto1.de] INFO: Scrape type for RM03411: 0
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: WG01413
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: VR34423
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR34423%27 HTTP/1.1" 200 None
2026-03-28 07:43:55 [auto1.de] INFO: Scrape type for VR34423: 0
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: MN31316
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: BJ91996
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ91996%27 HTTP/1.1" 200 None
2026-03-28 07:43:55 [auto1.de] INFO: Scrape type for BJ91996: 0
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: MV29238
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: AB14083
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB14083%27 HTTP/1.1" 200 None
2026-03-28 07:43:55 [auto1.de] INFO: Scrape type for AB14083: 0
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: HL71363
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL71363%27 HTTP/1.1" 200 None
2026-03-28 07:43:55 [auto1.de] INFO: Scrape type for HL71363: 0
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: ZZ67378
2026-03-28 07:43:55 [auto1.de] INFO: Found listing with ID: GH57189
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH57189%27 HTTP/1.1" 200 None
2026-03-28 07:43:55 [auto1.de] INFO: Scrape type for GH57189: 0
2026-03-28 07:43:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:43:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:43:56 [auto1.de] INFO: Channel: 24h | Page: 227 | totalHits: 9266 | hits on page: 40
2026-03-28 07:43:56 [auto1.de] INFO: Found listing with ID: DP29257
2026-03-28 07:43:56 [auto1.de] INFO: Found listing with ID: NB18835
2026-03-28 07:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB18835%27 HTTP/1.1" 200 None
2026-03-28 07:43:56 [auto1.de] INFO: Scrape type for NB18835: 0
2026-03-28 07:43:56 [auto1.de] INFO: Found listing with ID: AB91647
2026-03-28 07:43:56 [auto1.de] INFO: Found listing with ID: CR29385
2026-03-28 07:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR29385%27 HTTP/1.1" 200 None
2026-03-28 07:43:56 [auto1.de] INFO: Scrape type for CR29385: 0
2026-03-28 07:43:56 [auto1.de] INFO: Found listing with ID: GD61504
2026-03-28 07:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61504%27 HTTP/1.1" 200 None
2026-03-28 07:43:56 [auto1.de] INFO: Scrape type for GD61504: 0
2026-03-28 07:43:56 [auto1.de] INFO: Found listing with ID: LM89812
2026-03-28 07:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM89812%27 HTTP/1.1" 200 None
2026-03-28 07:43:56 [auto1.de] INFO: Scrape type for LM89812: 0
2026-03-28 07:43:56 [auto1.de] INFO: Found listing with ID: MC56654
2026-03-28 07:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC56654%27 HTTP/1.1" 200 None
2026-03-28 07:43:56 [auto1.de] INFO: Scrape type for MC56654: 0
2026-03-28 07:43:56 [auto1.de] INFO: Found listing with ID: DE97424
2026-03-28 07:43:56 [auto1.de] INFO: Found listing with ID: VU87810
2026-03-28 07:43:56 [auto1.de] INFO: Found listing with ID: ZE75344
2026-03-28 07:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE75344%27 HTTP/1.1" 200 None
2026-03-28 07:43:56 [auto1.de] INFO: Scrape type for ZE75344: 0
2026-03-28 07:43:56 [auto1.de] INFO: Found listing with ID: TN35459
2026-03-28 07:43:56 [auto1.de] INFO: Found listing with ID: YT23493
2026-03-28 07:43:56 [auto1.de] INFO: Found listing with ID: JR97371
2026-03-28 07:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR97371%27 HTTP/1.1" 200 None
2026-03-28 07:43:56 [auto1.de] INFO: Scrape type for JR97371: 0
2026-03-28 07:43:56 [auto1.de] INFO: Found listing with ID: SG45396
2026-03-28 07:43:56 [auto1.de] INFO: Found listing with ID: XJ62576
2026-03-28 07:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ62576%27 HTTP/1.1" 200 None
2026-03-28 07:43:56 [auto1.de] INFO: Scrape type for XJ62576: 0
2026-03-28 07:43:56 [auto1.de] INFO: Found listing with ID: MV46979
2026-03-28 07:43:56 [auto1.de] INFO: Found listing with ID: ZV10923
2026-03-28 07:43:56 [auto1.de] INFO: Found listing with ID: XX83628
2026-03-28 07:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX83628%27 HTTP/1.1" 200 None
2026-03-28 07:43:56 [auto1.de] INFO: Scrape type for XX83628: 0
2026-03-28 07:43:56 [auto1.de] INFO: Found listing with ID: ZY72717
2026-03-28 07:43:56 [auto1.de] INFO: Found listing with ID: CY44920
2026-03-28 07:43:56 [auto1.de] INFO: Found listing with ID: DM13382
2026-03-28 07:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM13382%27 HTTP/1.1" 200 None
2026-03-28 07:43:56 [auto1.de] INFO: Scrape type for DM13382: 0
2026-03-28 07:43:56 [auto1.de] INFO: Found listing with ID: DV32986
2026-03-28 07:43:56 [auto1.de] INFO: Found listing with ID: CC90437
2026-03-28 07:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC90437%27 HTTP/1.1" 200 None
2026-03-28 07:43:57 [auto1.de] INFO: Scrape type for CC90437: 0
2026-03-28 07:43:57 [auto1.de] INFO: Found listing with ID: SM08668
2026-03-28 07:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM08668%27 HTTP/1.1" 200 None
2026-03-28 07:43:57 [auto1.de] INFO: Scrape type for SM08668: 0
2026-03-28 07:43:57 [auto1.de] INFO: Found listing with ID: ND31150
2026-03-28 07:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND31150%27 HTTP/1.1" 200 None
2026-03-28 07:43:57 [auto1.de] INFO: Scrape type for ND31150: 0
2026-03-28 07:43:57 [auto1.de] INFO: Found listing with ID: CB12842
2026-03-28 07:43:57 [auto1.de] INFO: Found listing with ID: YB40017
2026-03-28 07:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB40017%27 HTTP/1.1" 200 None
2026-03-28 07:43:57 [auto1.de] INFO: Scrape type for YB40017: 0
2026-03-28 07:43:57 [auto1.de] INFO: Found listing with ID: UZ74086
2026-03-28 07:43:57 [auto1.de] INFO: Found listing with ID: UT27249
2026-03-28 07:43:57 [auto1.de] INFO: Found listing with ID: YB62347
2026-03-28 07:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB62347%27 HTTP/1.1" 200 None
2026-03-28 07:43:57 [auto1.de] INFO: Scrape type for YB62347: 0
2026-03-28 07:43:57 [auto1.de] INFO: Found listing with ID: UY13477
2026-03-28 07:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY13477%27 HTTP/1.1" 200 None
2026-03-28 07:43:57 [auto1.de] INFO: Scrape type for UY13477: 0
2026-03-28 07:43:57 [auto1.de] INFO: Found listing with ID: ML66978
2026-03-28 07:43:57 [auto1.de] INFO: Found listing with ID: CJ75930
2026-03-28 07:43:57 [auto1.de] INFO: Found listing with ID: XW49468
2026-03-28 07:43:57 [auto1.de] INFO: Found listing with ID: SR08314
2026-03-28 07:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR08314%27 HTTP/1.1" 200 None
2026-03-28 07:43:57 [auto1.de] INFO: Scrape type for SR08314: 0
2026-03-28 07:43:57 [auto1.de] INFO: Found listing with ID: PC62397
2026-03-28 07:43:57 [auto1.de] INFO: Found listing with ID: MX32750
2026-03-28 07:43:57 [auto1.de] INFO: Found listing with ID: JS15071
2026-03-28 07:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS15071%27 HTTP/1.1" 200 None
2026-03-28 07:43:57 [auto1.de] INFO: Scrape type for JS15071: 0
2026-03-28 07:43:57 [auto1.de] INFO: Found listing with ID: RA07752
2026-03-28 07:43:57 [auto1.de] INFO: Found listing with ID: CD13649
2026-03-28 07:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD13649%27 HTTP/1.1" 200 None
2026-03-28 07:43:57 [auto1.de] INFO: Scrape type for CD13649: 0
2026-03-28 07:43:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:43:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:43:58 [auto1.de] INFO: Channel: 24h | Page: 228 | totalHits: 9266 | hits on page: 40
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: WF06816
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: HR10791
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10791%27 HTTP/1.1" 200 None
2026-03-28 07:43:58 [auto1.de] INFO: Scrape type for HR10791: 0
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: GS36326
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36326%27 HTTP/1.1" 200 None
2026-03-28 07:43:58 [auto1.de] INFO: Scrape type for GS36326: 0
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: XV66825
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: FR75488
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR75488%27 HTTP/1.1" 200 None
2026-03-28 07:43:58 [auto1.de] INFO: Scrape type for FR75488: 0
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: MD11027
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD11027%27 HTTP/1.1" 200 None
2026-03-28 07:43:58 [auto1.de] INFO: Scrape type for MD11027: 0
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: VT63702
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT63702%27 HTTP/1.1" 200 None
2026-03-28 07:43:58 [auto1.de] INFO: Scrape type for VT63702: 0
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: JW24568
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: SU14933
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU14933%27 HTTP/1.1" 200 None
2026-03-28 07:43:58 [auto1.de] INFO: Scrape type for SU14933: 0
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: LG62730
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG62730%27 HTTP/1.1" 200 None
2026-03-28 07:43:58 [auto1.de] INFO: Scrape type for LG62730: 0
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: RT88012
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: JH21308
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH21308%27 HTTP/1.1" 200 None
2026-03-28 07:43:58 [auto1.de] INFO: Scrape type for JH21308: 0
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: EU73133
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: HB31061
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB31061%27 HTTP/1.1" 200 None
2026-03-28 07:43:58 [auto1.de] INFO: Scrape type for HB31061: 0
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: AN15165
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: YK99785
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: AB88110
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB88110%27 HTTP/1.1" 200 None
2026-03-28 07:43:58 [auto1.de] INFO: Scrape type for AB88110: 0
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: EG76856
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: FU68975
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: GP68218
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP68218%27 HTTP/1.1" 200 None
2026-03-28 07:43:58 [auto1.de] INFO: Scrape type for GP68218: 0
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: WZ51755
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ51755%27 HTTP/1.1" 200 None
2026-03-28 07:43:58 [auto1.de] INFO: Scrape type for WZ51755: 0
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: VN54723
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: AE42693
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE42693%27 HTTP/1.1" 200 None
2026-03-28 07:43:58 [auto1.de] INFO: Scrape type for AE42693: 0
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: DK89074
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK89074%27 HTTP/1.1" 200 None
2026-03-28 07:43:58 [auto1.de] INFO: Scrape type for DK89074: 0
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: RC64301
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: TB14981
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: RJ96114
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ96114%27 HTTP/1.1" 200 None
2026-03-28 07:43:58 [auto1.de] INFO: Scrape type for RJ96114: 0
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: PA20304
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: EE00996
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: NP68778
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP68778%27 HTTP/1.1" 200 None
2026-03-28 07:43:58 [auto1.de] INFO: Scrape type for NP68778: 0
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: VJ29661
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: SX40224
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: XS17240
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: MV46012
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46012%27 HTTP/1.1" 200 None
2026-03-28 07:43:58 [auto1.de] INFO: Scrape type for MV46012: 0
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: JL91815
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL91815%27 HTTP/1.1" 200 None
2026-03-28 07:43:58 [auto1.de] INFO: Scrape type for JL91815: 0
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: EK35927
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: PC18756
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC18756%27 HTTP/1.1" 200 None
2026-03-28 07:43:58 [auto1.de] INFO: Scrape type for PC18756: 0
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: AY57435
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY57435%27 HTTP/1.1" 200 None
2026-03-28 07:43:58 [auto1.de] INFO: Scrape type for AY57435: 0
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: NV35825
2026-03-28 07:43:58 [auto1.de] INFO: Found listing with ID: GB27132
2026-03-28 07:43:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:43:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:43:59 [auto1.de] INFO: Channel: 24h | Page: 229 | totalHits: 9266 | hits on page: 40
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: SR34905
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: BN62296
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: PJ38214
2026-03-28 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ38214%27 HTTP/1.1" 200 None
2026-03-28 07:43:59 [auto1.de] INFO: Scrape type for PJ38214: 0
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: AJ78717
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: TA14554
2026-03-28 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA14554%27 HTTP/1.1" 200 None
2026-03-28 07:43:59 [auto1.de] INFO: Scrape type for TA14554: 0
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: GN45872
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: NS35673
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: FW84065
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: BP24575
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: JA25299
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: HV14674
2026-03-28 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV14674%27 HTTP/1.1" 200 None
2026-03-28 07:43:59 [auto1.de] INFO: Scrape type for HV14674: 0
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: VH71903
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: ZD28576
2026-03-28 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD28576%27 HTTP/1.1" 200 None
2026-03-28 07:43:59 [auto1.de] INFO: Scrape type for ZD28576: 0
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: GD02806
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: GB27977
2026-03-28 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27977%27 HTTP/1.1" 200 None
2026-03-28 07:43:59 [auto1.de] INFO: Scrape type for GB27977: 0
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: GH74073
2026-03-28 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH74073%27 HTTP/1.1" 200 None
2026-03-28 07:43:59 [auto1.de] INFO: Scrape type for GH74073: 0
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: SL27608
2026-03-28 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL27608%27 HTTP/1.1" 200 None
2026-03-28 07:43:59 [auto1.de] INFO: Scrape type for SL27608: 0
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: DN13458
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: YV03143
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: UR56671
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: GY83216
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: DB09023
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: GA20411
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: VU07666
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: YU21879
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: VX14305
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: BP39068
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: SK60410
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: XS67256
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: CS24568
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: DV41377
2026-03-28 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41377%27 HTTP/1.1" 200 None
2026-03-28 07:43:59 [auto1.de] INFO: Scrape type for DV41377: 0
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: RR95104
2026-03-28 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR95104%27 HTTP/1.1" 200 None
2026-03-28 07:43:59 [auto1.de] INFO: Scrape type for RR95104: 0
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: RB29698
2026-03-28 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB29698%27 HTTP/1.1" 200 None
2026-03-28 07:43:59 [auto1.de] INFO: Scrape type for RB29698: 0
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: TJ54274
2026-03-28 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ54274%27 HTTP/1.1" 200 None
2026-03-28 07:43:59 [auto1.de] INFO: Scrape type for TJ54274: 0
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: BN99160
2026-03-28 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN99160%27 HTTP/1.1" 200 None
2026-03-28 07:43:59 [auto1.de] INFO: Scrape type for BN99160: 0
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: YS72291
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: NU40384
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: SU61840
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: FD22353
2026-03-28 07:43:59 [auto1.de] INFO: Found listing with ID: WZ92700
2026-03-28 07:43:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:44:00 [auto1.de] INFO: Channel: 24h | Page: 230 | totalHits: 9266 | hits on page: 40
2026-03-28 07:44:00 [auto1.de] INFO: Found listing with ID: XN26589
2026-03-28 07:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26589%27 HTTP/1.1" 200 None
2026-03-28 07:44:00 [auto1.de] INFO: Scrape type for XN26589: 0
2026-03-28 07:44:00 [auto1.de] INFO: Found listing with ID: HP95404
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP95404%27 HTTP/1.1" 200 None
2026-03-28 07:44:01 [auto1.de] INFO: Scrape type for HP95404: 0
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: XY63966
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: AB73354
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB73354%27 HTTP/1.1" 200 None
2026-03-28 07:44:01 [auto1.de] INFO: Scrape type for AB73354: 0
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: FZ45055
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: AR79819
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: SZ74678
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ74678%27 HTTP/1.1" 200 None
2026-03-28 07:44:01 [auto1.de] INFO: Scrape type for SZ74678: 0
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: RT76020
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT76020%27 HTTP/1.1" 200 None
2026-03-28 07:44:01 [auto1.de] INFO: Scrape type for RT76020: 0
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: EL90308
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: GV00084
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: SA17140
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA17140%27 HTTP/1.1" 200 None
2026-03-28 07:44:01 [auto1.de] INFO: Scrape type for SA17140: 0
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: MH67551
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: VY78817
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY78817%27 HTTP/1.1" 200 None
2026-03-28 07:44:01 [auto1.de] INFO: Scrape type for VY78817: 0
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: HN51683
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: VT53198
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: AY50267
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY50267%27 HTTP/1.1" 200 None
2026-03-28 07:44:01 [auto1.de] INFO: Scrape type for AY50267: 0
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: HP12091
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP12091%27 HTTP/1.1" 200 None
2026-03-28 07:44:01 [auto1.de] INFO: Scrape type for HP12091: 0
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: PB00515
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB00515%27 HTTP/1.1" 200 None
2026-03-28 07:44:01 [auto1.de] INFO: Scrape type for PB00515: 0
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: XX92411
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: PD95192
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: NY45710
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: GV20028
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: ZE10872
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE10872%27 HTTP/1.1" 200 None
2026-03-28 07:44:01 [auto1.de] INFO: Scrape type for ZE10872: 0
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: ZV16812
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: CF89653
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: HD43211
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: VE44500
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE44500%27 HTTP/1.1" 200 None
2026-03-28 07:44:01 [auto1.de] INFO: Scrape type for VE44500: 0
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: WX24181
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: KS08572
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS08572%27 HTTP/1.1" 200 None
2026-03-28 07:44:01 [auto1.de] INFO: Scrape type for KS08572: 0
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: VE61397
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: GJ83963
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: ZT05209
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: SY84491
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: ZU82600
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: XL56937
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: AS68475
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: EE25450
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: ZN04335
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN04335%27 HTTP/1.1" 200 None
2026-03-28 07:44:01 [auto1.de] INFO: Scrape type for ZN04335: 0
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: WR57027
2026-03-28 07:44:01 [auto1.de] INFO: Found listing with ID: RW32541
2026-03-28 07:44:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:44:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:44:02 [auto1.de] INFO: Channel: 24h | Page: 231 | totalHits: 9266 | hits on page: 40
2026-03-28 07:44:02 [auto1.de] INFO: Found listing with ID: JR60766
2026-03-28 07:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR60766%27 HTTP/1.1" 200 None
2026-03-28 07:44:02 [auto1.de] INFO: Scrape type for JR60766: 0
2026-03-28 07:44:02 [auto1.de] INFO: Found listing with ID: TM66386
2026-03-28 07:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM66386%27 HTTP/1.1" 200 None
2026-03-28 07:44:02 [auto1.de] INFO: Scrape type for TM66386: 0
2026-03-28 07:44:02 [auto1.de] INFO: Found listing with ID: MH24339
2026-03-28 07:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH24339%27 HTTP/1.1" 200 None
2026-03-28 07:44:02 [auto1.de] INFO: Scrape type for MH24339: 0
2026-03-28 07:44:02 [auto1.de] INFO: Found listing with ID: KS94316
2026-03-28 07:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS94316%27 HTTP/1.1" 200 None
2026-03-28 07:44:02 [auto1.de] INFO: Scrape type for KS94316: 0
2026-03-28 07:44:02 [auto1.de] INFO: Found listing with ID: JR21224
2026-03-28 07:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR21224%27 HTTP/1.1" 200 None
2026-03-28 07:44:02 [auto1.de] INFO: Scrape type for JR21224: 0
2026-03-28 07:44:02 [auto1.de] INFO: Found listing with ID: MB99639
2026-03-28 07:44:02 [auto1.de] INFO: Found listing with ID: YF85970
2026-03-28 07:44:02 [auto1.de] INFO: Found listing with ID: XA59954
2026-03-28 07:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA59954%27 HTTP/1.1" 200 None
2026-03-28 07:44:02 [auto1.de] INFO: Scrape type for XA59954: 2
2026-03-28 07:44:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e96fbded-52a2-5b96-91fc-d7b6b502471b with identifier: XA59954
2026-03-28 07:44:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e96fbded-52a2-5b96-91fc-d7b6b502471b with scrape type 2
2026-03-28 07:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e96fbded-52a2-5b96-91fc-d7b6b502471b with scrape type 2
2026-03-28 07:44:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e96fbded-52a2-5b96-91fc-d7b6b502471b, identifier: XA59954
2026-03-28 07:44:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e96fbded-52a2-5b96-91fc-d7b6b502471b with identifier: XA59954
2026-03-28 07:44:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e96fbded-52a2-5b96-91fc-d7b6b502471b with identifier: XA59954
2026-03-28 07:44:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e96fbded-52a2-5b96-91fc-d7b6b502471b with identifier: XA59954 to the API
2026-03-28 07:44:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:44:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:44:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:15:55Z',
'fuel_type': 'petrol',
'id': 'e96fbded-52a2-5b96-91fc-d7b6b502471b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA59954',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 201006,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-17',
'seller_name': None,
'title': 'Opel Meriva 1.4 Turbo Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2014}
2026-03-28 07:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA59954%27 HTTP/1.1" 200 None
2026-03-28 07:44:03 [auto1.de] INFO: Saving data for XA59954: {'auction_closing_time': 1774714555.0, 'created_time': 1774001889.108418, 'last_price_update_time': 1774683843.501093}
2026-03-28 07:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA59954') HTTP/1.1" 204 0
2026-03-28 07:44:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:44:03 [auto1.de] INFO: Found listing with ID: DZ93039
2026-03-28 07:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ93039%27 HTTP/1.1" 200 None
2026-03-28 07:44:03 [auto1.de] INFO: Scrape type for DZ93039: 2
2026-03-28 07:44:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e76f8261-06ba-568c-81f1-805c9644ba47 with identifier: DZ93039
2026-03-28 07:44:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e76f8261-06ba-568c-81f1-805c9644ba47 with scrape type 2
2026-03-28 07:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e76f8261-06ba-568c-81f1-805c9644ba47 with scrape type 2
2026-03-28 07:44:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e76f8261-06ba-568c-81f1-805c9644ba47, identifier: DZ93039
2026-03-28 07:44:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e76f8261-06ba-568c-81f1-805c9644ba47 with identifier: DZ93039
2026-03-28 07:44:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e76f8261-06ba-568c-81f1-805c9644ba47 with identifier: DZ93039
2026-03-28 07:44:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e76f8261-06ba-568c-81f1-805c9644ba47 with identifier: DZ93039 to the API
2026-03-28 07:44:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:44:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:44:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:23:16Z',
'fuel_type': 'petrol',
'id': 'e76f8261-06ba-568c-81f1-805c9644ba47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ93039',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 106535,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-12',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2017}
2026-03-28 07:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ93039%27 HTTP/1.1" 200 None
2026-03-28 07:44:04 [auto1.de] INFO: Saving data for DZ93039: {'auction_closing_time': 1774714996.0, 'created_time': 1773427172.994331, 'last_price_update_time': 1774683844.071453}
2026-03-28 07:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ93039') HTTP/1.1" 204 0
2026-03-28 07:44:04 [auto1.de] INFO: Found listing with ID: KK39591
2026-03-28 07:44:04 [auto1.de] INFO: Found listing with ID: NB74696
2026-03-28 07:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB74696%27 HTTP/1.1" 200 None
2026-03-28 07:44:04 [auto1.de] INFO: Scrape type for NB74696: 2
2026-03-28 07:44:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96c7d80f-7dff-543d-8ffb-1ac5b324f0bd with identifier: NB74696
2026-03-28 07:44:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96c7d80f-7dff-543d-8ffb-1ac5b324f0bd with scrape type 2
2026-03-28 07:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96c7d80f-7dff-543d-8ffb-1ac5b324f0bd with scrape type 2
2026-03-28 07:44:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96c7d80f-7dff-543d-8ffb-1ac5b324f0bd, identifier: NB74696
2026-03-28 07:44:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96c7d80f-7dff-543d-8ffb-1ac5b324f0bd with identifier: NB74696
2026-03-28 07:44:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96c7d80f-7dff-543d-8ffb-1ac5b324f0bd with identifier: NB74696
2026-03-28 07:44:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96c7d80f-7dff-543d-8ffb-1ac5b324f0bd with identifier: NB74696 to the API
2026-03-28 07:44:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:44:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:44:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:36:56Z',
'fuel_type': 'petrol',
'id': '96c7d80f-7dff-543d-8ffb-1ac5b324f0bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB74696',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 158883,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-12',
'seller_name': None,
'title': 'Dacia Sandero 1.6 Stepway II',
'transmission': 'manual',
'trim': 'Stepway II',
'year': 2012}
2026-03-28 07:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB74696%27 HTTP/1.1" 200 None
2026-03-28 07:44:05 [auto1.de] INFO: Saving data for NB74696: {'auction_closing_time': 1774715816.0, 'created_time': 1773427849.428619, 'last_price_update_time': 1774683845.131946}
2026-03-28 07:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB74696') HTTP/1.1" 204 0
2026-03-28 07:44:05 [auto1.de] INFO: Found listing with ID: PA91230
2026-03-28 07:44:05 [auto1.de] INFO: Found listing with ID: MK66887
2026-03-28 07:44:05 [auto1.de] INFO: Found listing with ID: PS74193
2026-03-28 07:44:05 [auto1.de] INFO: Found listing with ID: LR74805
2026-03-28 07:44:05 [auto1.de] INFO: Found listing with ID: PR32105
2026-03-28 07:44:05 [auto1.de] INFO: Found listing with ID: JZ77748
2026-03-28 07:44:05 [auto1.de] INFO: Found listing with ID: LJ18760
2026-03-28 07:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ18760%27 HTTP/1.1" 200 None
2026-03-28 07:44:05 [auto1.de] INFO: Scrape type for LJ18760: 2
2026-03-28 07:44:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faf327d3-7715-5496-9bd5-cef1eef3ec2f with identifier: LJ18760
2026-03-28 07:44:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faf327d3-7715-5496-9bd5-cef1eef3ec2f with scrape type 2
2026-03-28 07:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faf327d3-7715-5496-9bd5-cef1eef3ec2f with scrape type 2
2026-03-28 07:44:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: faf327d3-7715-5496-9bd5-cef1eef3ec2f, identifier: LJ18760
2026-03-28 07:44:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: faf327d3-7715-5496-9bd5-cef1eef3ec2f with identifier: LJ18760
2026-03-28 07:44:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: faf327d3-7715-5496-9bd5-cef1eef3ec2f with identifier: LJ18760
2026-03-28 07:44:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: faf327d3-7715-5496-9bd5-cef1eef3ec2f with identifier: LJ18760 to the API
2026-03-28 07:44:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:44:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:44:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:53:37Z',
'fuel_type': 'petrol',
'id': 'faf327d3-7715-5496-9bd5-cef1eef3ec2f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ18760',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 50564,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-08',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 T-GDI Mild-Hybrid Trend 2WD',
'transmission': 'automatic',
'trim': 'Trend 2WD',
'year': 2023}
2026-03-28 07:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ18760%27 HTTP/1.1" 200 None
2026-03-28 07:44:05 [auto1.de] INFO: Saving data for LJ18760: {'auction_closing_time': 1774716817.0, 'created_time': 1774596634.790609, 'last_price_update_time': 1774683845.571316}
2026-03-28 07:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ18760') HTTP/1.1" 204 0
2026-03-28 07:44:05 [auto1.de] INFO: Found listing with ID: VS70073
2026-03-28 07:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS70073%27 HTTP/1.1" 200 None
2026-03-28 07:44:05 [auto1.de] INFO: Scrape type for VS70073: 2
2026-03-28 07:44:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47cf8992-6ada-55eb-b88a-a95df9279cda with identifier: VS70073
2026-03-28 07:44:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47cf8992-6ada-55eb-b88a-a95df9279cda with scrape type 2
2026-03-28 07:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47cf8992-6ada-55eb-b88a-a95df9279cda with scrape type 2
2026-03-28 07:44:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47cf8992-6ada-55eb-b88a-a95df9279cda, identifier: VS70073
2026-03-28 07:44:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47cf8992-6ada-55eb-b88a-a95df9279cda with identifier: VS70073
2026-03-28 07:44:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47cf8992-6ada-55eb-b88a-a95df9279cda with identifier: VS70073
2026-03-28 07:44:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47cf8992-6ada-55eb-b88a-a95df9279cda with identifier: VS70073 to the API
2026-03-28 07:44:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:44:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:44:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-28T16:07:05Z',
'fuel_type': 'diesel',
'id': '47cf8992-6ada-55eb-b88a-a95df9279cda',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS70073',
'listing': 'auction',
'make': 'Toyota',
'model': 'ProAce Verso',
'odometer': 45588,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-31',
'seller_name': None,
'title': 'Toyota ProAce Verso 2.0 D-4D L2 Executive',
'transmission': 'automatic',
'trim': 'L2 Executive',
'year': 2021}
2026-03-28 07:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS70073%27 HTTP/1.1" 200 None
2026-03-28 07:44:06 [auto1.de] INFO: Saving data for VS70073: {'auction_closing_time': 1774714025.0, 'created_time': 1772729327.876622, 'last_price_update_time': 1774683846.642682}
2026-03-28 07:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS70073') HTTP/1.1" 204 0
2026-03-28 07:44:06 [auto1.de] INFO: Found listing with ID: BV72825
2026-03-28 07:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV72825%27 HTTP/1.1" 200 None
2026-03-28 07:44:06 [auto1.de] INFO: Scrape type for BV72825: 2
2026-03-28 07:44:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2184530-3e2f-58a2-b1d5-b0d8dc8452e3 with identifier: BV72825
2026-03-28 07:44:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2184530-3e2f-58a2-b1d5-b0d8dc8452e3 with scrape type 2
2026-03-28 07:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2184530-3e2f-58a2-b1d5-b0d8dc8452e3 with scrape type 2
2026-03-28 07:44:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2184530-3e2f-58a2-b1d5-b0d8dc8452e3, identifier: BV72825
2026-03-28 07:44:06 [scrapy.extensions.logstats] INFO: Crawled 237 pages (at 24 pages/min), scraped 480 items (at 5 items/min)
2026-03-28 07:44:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 165MiB
2026-03-28 07:44:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2184530-3e2f-58a2-b1d5-b0d8dc8452e3 with identifier: BV72825
2026-03-28 07:44:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2184530-3e2f-58a2-b1d5-b0d8dc8452e3 with identifier: BV72825
2026-03-28 07:44:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2184530-3e2f-58a2-b1d5-b0d8dc8452e3 with identifier: BV72825 to the API
2026-03-28 07:44:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:44:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:44:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:17:32Z',
'fuel_type': 'petrol',
'id': 'd2184530-3e2f-58a2-b1d5-b0d8dc8452e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV72825',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 162325,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-16',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 250 CGI T BlueEfficiency Elegance',
'transmission': 'automatic',
'trim': 'T BlueEfficiency Elegance',
'year': 2010}
2026-03-28 07:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV72825%27 HTTP/1.1" 200 None
2026-03-28 07:44:07 [auto1.de] INFO: Saving data for BV72825: {'auction_closing_time': 1774714652.0, 'created_time': 1774348997.25977, 'last_price_update_time': 1774683847.147829}
2026-03-28 07:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV72825') HTTP/1.1" 204 0
2026-03-28 07:44:07 [auto1.de] INFO: Found listing with ID: PC54286
2026-03-28 07:44:07 [auto1.de] INFO: Found listing with ID: SD36670
2026-03-28 07:44:07 [auto1.de] INFO: Found listing with ID: TZ67975
2026-03-28 07:44:07 [auto1.de] INFO: Found listing with ID: UM48488
2026-03-28 07:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM48488%27 HTTP/1.1" 200 None
2026-03-28 07:44:07 [auto1.de] INFO: Scrape type for UM48488: 2
2026-03-28 07:44:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79273a23-7734-5ce5-82b7-37bfab0638e7 with identifier: UM48488
2026-03-28 07:44:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79273a23-7734-5ce5-82b7-37bfab0638e7 with scrape type 2
2026-03-28 07:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79273a23-7734-5ce5-82b7-37bfab0638e7 with scrape type 2
2026-03-28 07:44:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79273a23-7734-5ce5-82b7-37bfab0638e7, identifier: UM48488
2026-03-28 07:44:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79273a23-7734-5ce5-82b7-37bfab0638e7 with identifier: UM48488
2026-03-28 07:44:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79273a23-7734-5ce5-82b7-37bfab0638e7 with identifier: UM48488
2026-03-28 07:44:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79273a23-7734-5ce5-82b7-37bfab0638e7 with identifier: UM48488 to the API
2026-03-28 07:44:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:44:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:44:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:24:20Z',
'fuel_type': 'diesel',
'id': '79273a23-7734-5ce5-82b7-37bfab0638e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM48488',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'V-Klasse',
'odometer': 154940,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-20',
'seller_name': None,
'title': 'Mercedes-Benz V-Klasse V 250 d lang 4Matic BlueTEC Edition',
'transmission': 'automatic',
'trim': 'lang 4Matic BlueTEC Edition',
'year': 2015}
2026-03-28 07:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM48488%27 HTTP/1.1" 200 None
2026-03-28 07:44:08 [auto1.de] INFO: Saving data for UM48488: {'auction_closing_time': 1774715060.0, 'created_time': 1773466812.337144, 'last_price_update_time': 1774683848.13884}
2026-03-28 07:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UM48488') HTTP/1.1" 204 0
2026-03-28 07:44:08 [auto1.de] INFO: Found listing with ID: FV46397
2026-03-28 07:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV46397%27 HTTP/1.1" 200 None
2026-03-28 07:44:08 [auto1.de] INFO: Scrape type for FV46397: 2
2026-03-28 07:44:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 328c70d1-6864-50cc-a61a-6c1db0f98b78 with identifier: FV46397
2026-03-28 07:44:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 328c70d1-6864-50cc-a61a-6c1db0f98b78 with scrape type 2
2026-03-28 07:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 328c70d1-6864-50cc-a61a-6c1db0f98b78 with scrape type 2
2026-03-28 07:44:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 328c70d1-6864-50cc-a61a-6c1db0f98b78, identifier: FV46397
2026-03-28 07:44:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 328c70d1-6864-50cc-a61a-6c1db0f98b78 with identifier: FV46397
2026-03-28 07:44:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 328c70d1-6864-50cc-a61a-6c1db0f98b78 with identifier: FV46397
2026-03-28 07:44:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 328c70d1-6864-50cc-a61a-6c1db0f98b78 with identifier: FV46397 to the API
2026-03-28 07:44:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:44:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:44:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:05:54Z',
'fuel_type': 'petrol',
'id': '328c70d1-6864-50cc-a61a-6c1db0f98b78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV46397',
'listing': 'auction',
'make': 'Suzuki',
'model': 'SX4',
'odometer': 99311,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-30',
'seller_name': None,
'title': 'Suzuki SX4 1.6 Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2012}
2026-03-28 07:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV46397%27 HTTP/1.1" 200 None
2026-03-28 07:44:08 [auto1.de] INFO: Saving data for FV46397: {'auction_closing_time': 1774713954.0, 'created_time': 1773137679.091028, 'last_price_update_time': 1774683848.544199}
2026-03-28 07:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV46397') HTTP/1.1" 204 0
2026-03-28 07:44:08 [auto1.de] INFO: Found listing with ID: VA13792
2026-03-28 07:44:08 [auto1.de] INFO: Found listing with ID: UZ08427
2026-03-28 07:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ08427%27 HTTP/1.1" 200 None
2026-03-28 07:44:08 [auto1.de] INFO: Scrape type for UZ08427: 2
2026-03-28 07:44:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60d5584a-3b51-5607-b3a2-191fc05a1394 with identifier: UZ08427
2026-03-28 07:44:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60d5584a-3b51-5607-b3a2-191fc05a1394 with scrape type 2
2026-03-28 07:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60d5584a-3b51-5607-b3a2-191fc05a1394 with scrape type 2
2026-03-28 07:44:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60d5584a-3b51-5607-b3a2-191fc05a1394, identifier: UZ08427
2026-03-28 07:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:44:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60d5584a-3b51-5607-b3a2-191fc05a1394 with identifier: UZ08427
2026-03-28 07:44:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60d5584a-3b51-5607-b3a2-191fc05a1394 with identifier: UZ08427
2026-03-28 07:44:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60d5584a-3b51-5607-b3a2-191fc05a1394 with identifier: UZ08427 to the API
2026-03-28 07:44:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:44:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:44:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:38:35Z',
'fuel_type': 'diesel',
'id': '60d5584a-3b51-5607-b3a2-191fc05a1394',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ08427',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 187727,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-24',
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2012}
2026-03-28 07:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ08427%27 HTTP/1.1" 200 None
2026-03-28 07:44:09 [auto1.de] INFO: Saving data for UZ08427: {'auction_closing_time': 1774715915.0, 'created_time': 1773662188.403387, 'last_price_update_time': 1774683849.637153}
2026-03-28 07:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ08427') HTTP/1.1" 204 0
2026-03-28 07:44:09 [auto1.de] INFO: Found listing with ID: SK99321
2026-03-28 07:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK99321%27 HTTP/1.1" 200 None
2026-03-28 07:44:09 [auto1.de] INFO: Scrape type for SK99321: 2
2026-03-28 07:44:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5d6bc21-c8bc-5975-8fdd-379adbd8b706 with identifier: SK99321
2026-03-28 07:44:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5d6bc21-c8bc-5975-8fdd-379adbd8b706 with scrape type 2
2026-03-28 07:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5d6bc21-c8bc-5975-8fdd-379adbd8b706 with scrape type 2
2026-03-28 07:44:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e5d6bc21-c8bc-5975-8fdd-379adbd8b706, identifier: SK99321
2026-03-28 07:44:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e5d6bc21-c8bc-5975-8fdd-379adbd8b706 with identifier: SK99321
2026-03-28 07:44:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e5d6bc21-c8bc-5975-8fdd-379adbd8b706 with identifier: SK99321
2026-03-28 07:44:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e5d6bc21-c8bc-5975-8fdd-379adbd8b706 with identifier: SK99321 to the API
2026-03-28 07:44:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:44:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:44:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:56:15Z',
'fuel_type': 'diesel',
'id': 'e5d6bc21-c8bc-5975-8fdd-379adbd8b706',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK99321',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Viano',
'odometer': 375931,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-09-19',
'seller_name': None,
'title': 'Mercedes-Benz Viano 3.0 CDI lang Trend',
'transmission': 'automatic',
'trim': 'lang Trend',
'year': 2007}
2026-03-28 07:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK99321%27 HTTP/1.1" 200 None
2026-03-28 07:44:10 [auto1.de] INFO: Saving data for SK99321: {'auction_closing_time': 1774716975.0, 'created_time': 1773916765.89427, 'last_price_update_time': 1774683850.052984}
2026-03-28 07:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK99321') HTTP/1.1" 204 0
2026-03-28 07:44:10 [auto1.de] INFO: Found listing with ID: SG91001
2026-03-28 07:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG91001%27 HTTP/1.1" 200 None
2026-03-28 07:44:10 [auto1.de] INFO: Scrape type for SG91001: 2
2026-03-28 07:44:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4982cc3c-2250-5b45-942a-009b56c67ceb with identifier: SG91001
2026-03-28 07:44:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4982cc3c-2250-5b45-942a-009b56c67ceb with scrape type 2
2026-03-28 07:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4982cc3c-2250-5b45-942a-009b56c67ceb with scrape type 2
2026-03-28 07:44:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4982cc3c-2250-5b45-942a-009b56c67ceb, identifier: SG91001
2026-03-28 07:44:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4982cc3c-2250-5b45-942a-009b56c67ceb with identifier: SG91001
2026-03-28 07:44:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4982cc3c-2250-5b45-942a-009b56c67ceb with identifier: SG91001
2026-03-28 07:44:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4982cc3c-2250-5b45-942a-009b56c67ceb with identifier: SG91001 to the API
2026-03-28 07:44:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:44:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:44:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:01:41Z',
'fuel_type': 'petrol',
'id': '4982cc3c-2250-5b45-942a-009b56c67ceb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG91001',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 173645,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-18',
'seller_name': None,
'title': 'Renault Megane 1.4 TCe BOSE Edition',
'transmission': 'manual',
'trim': 'BOSE Edition',
'year': 2013}
2026-03-28 07:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG91001%27 HTTP/1.1" 200 None
2026-03-28 07:44:10 [auto1.de] INFO: Saving data for SG91001: {'auction_closing_time': 1774713701.0, 'created_time': 1774348903.964932, 'last_price_update_time': 1774683850.476853}
2026-03-28 07:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG91001') HTTP/1.1" 204 0
2026-03-28 07:44:10 [auto1.de] INFO: Channel: 24h | Page: 232 | totalHits: 9266 | hits on page: 26
2026-03-28 07:44:10 [auto1.de] INFO: Found listing with ID: HX49915
2026-03-28 07:44:10 [auto1.de] INFO: Found listing with ID: GA34239
2026-03-28 07:44:10 [auto1.de] INFO: Found listing with ID: BP51481
2026-03-28 07:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP51481%27 HTTP/1.1" 200 None
2026-03-28 07:44:10 [auto1.de] INFO: Scrape type for BP51481: 2
2026-03-28 07:44:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e513c85b-bed3-5b8a-961a-1206066b1754 with identifier: BP51481
2026-03-28 07:44:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e513c85b-bed3-5b8a-961a-1206066b1754 with scrape type 2
2026-03-28 07:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e513c85b-bed3-5b8a-961a-1206066b1754 with scrape type 2
2026-03-28 07:44:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e513c85b-bed3-5b8a-961a-1206066b1754, identifier: BP51481
2026-03-28 07:44:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e513c85b-bed3-5b8a-961a-1206066b1754 with identifier: BP51481
2026-03-28 07:44:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e513c85b-bed3-5b8a-961a-1206066b1754 with identifier: BP51481
2026-03-28 07:44:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e513c85b-bed3-5b8a-961a-1206066b1754 with identifier: BP51481 to the API
2026-03-28 07:44:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:44:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:44:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-28T16:35:01Z',
'fuel_type': 'diesel',
'id': 'e513c85b-bed3-5b8a-961a-1206066b1754',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP51481',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 185102,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-28',
'seller_name': None,
'title': 'Audi A4 3.0 V6 TDI clean diesel quattro S line Sportpaket plus',
'transmission': 'automatic',
'trim': 'quattro S line Sportpaket plus',
'year': 2015}
2026-03-28 07:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP51481%27 HTTP/1.1" 200 None
2026-03-28 07:44:10 [auto1.de] INFO: Saving data for BP51481: {'auction_closing_time': 1774715701.0, 'created_time': 1774262469.479961, 'last_price_update_time': 1774683850.920943}
2026-03-28 07:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP51481') HTTP/1.1" 204 0
2026-03-28 07:44:11 [auto1.de] INFO: Found listing with ID: PV47280
2026-03-28 07:44:11 [auto1.de] INFO: Found listing with ID: ME64315
2026-03-28 07:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME64315%27 HTTP/1.1" 200 None
2026-03-28 07:44:11 [auto1.de] INFO: Scrape type for ME64315: 2
2026-03-28 07:44:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7697bc61-fa0a-540d-a685-a5e42a561ae9 with identifier: ME64315
2026-03-28 07:44:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7697bc61-fa0a-540d-a685-a5e42a561ae9 with scrape type 2
2026-03-28 07:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7697bc61-fa0a-540d-a685-a5e42a561ae9 with scrape type 2
2026-03-28 07:44:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7697bc61-fa0a-540d-a685-a5e42a561ae9, identifier: ME64315
2026-03-28 07:44:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 07:44:11 [auto1.de] INFO: Found listing with ID: GR15033
2026-03-28 07:44:11 [auto1.de] INFO: Found listing with ID: XN11461
2026-03-28 07:44:11 [auto1.de] INFO: Found listing with ID: MX26895
2026-03-28 07:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX26895%27 HTTP/1.1" 200 None
2026-03-28 07:44:11 [auto1.de] INFO: Scrape type for MX26895: 2
2026-03-28 07:44:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f5927c0-898e-5593-b49f-51055df7b7c2 with identifier: MX26895
2026-03-28 07:44:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f5927c0-898e-5593-b49f-51055df7b7c2 with scrape type 2
2026-03-28 07:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f5927c0-898e-5593-b49f-51055df7b7c2 with scrape type 2
2026-03-28 07:44:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f5927c0-898e-5593-b49f-51055df7b7c2, identifier: MX26895
2026-03-28 07:44:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7697bc61-fa0a-540d-a685-a5e42a561ae9 with identifier: ME64315
2026-03-28 07:44:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7697bc61-fa0a-540d-a685-a5e42a561ae9 with identifier: ME64315
2026-03-28 07:44:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7697bc61-fa0a-540d-a685-a5e42a561ae9 with identifier: ME64315 to the API
2026-03-28 07:44:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:44:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:44:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:10:59Z',
'fuel_type': 'diesel',
'id': '7697bc61-fa0a-540d-a685-a5e42a561ae9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME64315',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 266282,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-02',
'seller_name': None,
'title': 'Volkswagen Sharan 2.0 TDI Cup BlueMotion',
'transmission': 'manual',
'trim': 'Cup BlueMotion',
'year': 2014}
2026-03-28 07:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME64315%27 HTTP/1.1" 200 None
2026-03-28 07:44:12 [auto1.de] INFO: Saving data for ME64315: {'auction_closing_time': 1774714259.0, 'created_time': 1773307791.268957, 'last_price_update_time': 1774683852.141993}
2026-03-28 07:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME64315') HTTP/1.1" 204 0
2026-03-28 07:44:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f5927c0-898e-5593-b49f-51055df7b7c2 with identifier: MX26895
2026-03-28 07:44:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f5927c0-898e-5593-b49f-51055df7b7c2 with identifier: MX26895
2026-03-28 07:44:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f5927c0-898e-5593-b49f-51055df7b7c2 with identifier: MX26895 to the API
2026-03-28 07:44:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:44:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:44:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:57:48Z',
'fuel_type': 'petrol',
'id': '7f5927c0-898e-5593-b49f-51055df7b7c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX26895',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 38040,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-07',
'seller_name': None,
'title': 'Smart fortwo 0.9 Turbo Perfect',
'transmission': 'manual',
'trim': 'Perfect',
'year': 2018}
2026-03-28 07:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX26895%27 HTTP/1.1" 200 None
2026-03-28 07:44:12 [auto1.de] INFO: Saving data for MX26895: {'auction_closing_time': 1774717068.0, 'created_time': 1774596636.931782, 'last_price_update_time': 1774683852.429502}
2026-03-28 07:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX26895') HTTP/1.1" 204 0
2026-03-28 07:44:12 [auto1.de] INFO: Found listing with ID: HJ54097
2026-03-28 07:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54097%27 HTTP/1.1" 200 None
2026-03-28 07:44:12 [auto1.de] INFO: Scrape type for HJ54097: 2
2026-03-28 07:44:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: feb9fca7-2a53-576c-8be8-d54e3e6a1ac0 with identifier: HJ54097
2026-03-28 07:44:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item feb9fca7-2a53-576c-8be8-d54e3e6a1ac0 with scrape type 2
2026-03-28 07:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item feb9fca7-2a53-576c-8be8-d54e3e6a1ac0 with scrape type 2
2026-03-28 07:44:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: feb9fca7-2a53-576c-8be8-d54e3e6a1ac0, identifier: HJ54097
2026-03-28 07:44:12 [auto1.de] INFO: Found listing with ID: HU88385
2026-03-28 07:44:12 [auto1.de] INFO: Found listing with ID: LD63966
2026-03-28 07:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63966%27 HTTP/1.1" 200 None
2026-03-28 07:44:12 [auto1.de] INFO: Scrape type for LD63966: 2
2026-03-28 07:44:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb8396d4-9655-572c-8e63-09596ed21c7d with identifier: LD63966
2026-03-28 07:44:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb8396d4-9655-572c-8e63-09596ed21c7d with scrape type 2
2026-03-28 07:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb8396d4-9655-572c-8e63-09596ed21c7d with scrape type 2
2026-03-28 07:44:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb8396d4-9655-572c-8e63-09596ed21c7d, identifier: LD63966
2026-03-28 07:44:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: feb9fca7-2a53-576c-8be8-d54e3e6a1ac0 with identifier: HJ54097
2026-03-28 07:44:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: feb9fca7-2a53-576c-8be8-d54e3e6a1ac0 with identifier: HJ54097
2026-03-28 07:44:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: feb9fca7-2a53-576c-8be8-d54e3e6a1ac0 with identifier: HJ54097 to the API
2026-03-28 07:44:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:44:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:44:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:46:14Z',
'fuel_type': 'diesel',
'id': 'feb9fca7-2a53-576c-8be8-d54e3e6a1ac0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ54097',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 135026,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-17',
'seller_name': None,
'title': 'Volkswagen Golf VI 2.0 TDI Team',
'transmission': 'manual',
'trim': 'Team',
'year': 2010}
2026-03-28 07:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54097%27 HTTP/1.1" 200 None
2026-03-28 07:44:12 [auto1.de] INFO: Saving data for HJ54097: {'auction_closing_time': 1774716374.0, 'created_time': 1774596634.348199, 'last_price_update_time': 1774683852.931298}
2026-03-28 07:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ54097') HTTP/1.1" 204 0
2026-03-28 07:44:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb8396d4-9655-572c-8e63-09596ed21c7d with identifier: LD63966
2026-03-28 07:44:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb8396d4-9655-572c-8e63-09596ed21c7d with identifier: LD63966
2026-03-28 07:44:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb8396d4-9655-572c-8e63-09596ed21c7d with identifier: LD63966 to the API
2026-03-28 07:44:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:44:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:44:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:01:26Z',
'fuel_type': 'petrol',
'id': 'cb8396d4-9655-572c-8e63-09596ed21c7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD63966',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 68954,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-19',
'seller_name': None,
'title': 'Ford Fiesta 1.1 Cool&Connect',
'transmission': 'manual',
'trim': 'Cool&Connect',
'year': 2018}
2026-03-28 07:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63966%27 HTTP/1.1" 200 None
2026-03-28 07:44:13 [auto1.de] INFO: Saving data for LD63966: {'auction_closing_time': 1774713686.0, 'created_time': 1774596636.321414, 'last_price_update_time': 1774683853.21181}
2026-03-28 07:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD63966') HTTP/1.1" 204 0
2026-03-28 07:44:13 [auto1.de] INFO: Found listing with ID: SZ94185
2026-03-28 07:44:13 [auto1.de] INFO: Found listing with ID: YD94034
2026-03-28 07:44:13 [auto1.de] INFO: Found listing with ID: SG58590
2026-03-28 07:44:13 [auto1.de] INFO: Found listing with ID: SW86673
2026-03-28 07:44:13 [auto1.de] INFO: Found listing with ID: PU13127
2026-03-28 07:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU13127%27 HTTP/1.1" 200 None
2026-03-28 07:44:13 [auto1.de] INFO: Scrape type for PU13127: 2
2026-03-28 07:44:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 486f9803-6151-5685-92af-9b5451c918dd with identifier: PU13127
2026-03-28 07:44:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 486f9803-6151-5685-92af-9b5451c918dd with scrape type 2
2026-03-28 07:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 486f9803-6151-5685-92af-9b5451c918dd with scrape type 2
2026-03-28 07:44:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 486f9803-6151-5685-92af-9b5451c918dd, identifier: PU13127
2026-03-28 07:44:13 [auto1.de] INFO: Found listing with ID: RN43410
2026-03-28 07:44:13 [auto1.de] INFO: Found listing with ID: UR77332
2026-03-28 07:44:13 [auto1.de] INFO: Found listing with ID: LJ04369
2026-03-28 07:44:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 486f9803-6151-5685-92af-9b5451c918dd with identifier: PU13127
2026-03-28 07:44:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 486f9803-6151-5685-92af-9b5451c918dd with identifier: PU13127
2026-03-28 07:44:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 486f9803-6151-5685-92af-9b5451c918dd with identifier: PU13127 to the API
2026-03-28 07:44:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:44:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:44:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 272,
'expiration_date': '2026-03-28T16:00:33Z',
'fuel_type': 'diesel',
'id': '486f9803-6151-5685-92af-9b5451c918dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU13127',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 220872,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-11',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2015}
2026-03-28 07:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU13127%27 HTTP/1.1" 200 None
2026-03-28 07:44:13 [auto1.de] INFO: Saving data for PU13127: {'auction_closing_time': 1774713633.0, 'created_time': 1774349526.69582, 'last_price_update_time': 1774683853.631138}
2026-03-28 07:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU13127') HTTP/1.1" 204 0
2026-03-28 07:44:13 [auto1.de] INFO: Found listing with ID: BX34768
2026-03-28 07:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX34768%27 HTTP/1.1" 200 None
2026-03-28 07:44:13 [auto1.de] INFO: Scrape type for BX34768: 2
2026-03-28 07:44:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17183509-0640-5e2d-ad31-9488c283422e with identifier: BX34768
2026-03-28 07:44:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17183509-0640-5e2d-ad31-9488c283422e with scrape type 2
2026-03-28 07:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17183509-0640-5e2d-ad31-9488c283422e with scrape type 2
2026-03-28 07:44:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17183509-0640-5e2d-ad31-9488c283422e, identifier: BX34768
2026-03-28 07:44:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17183509-0640-5e2d-ad31-9488c283422e with identifier: BX34768
2026-03-28 07:44:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17183509-0640-5e2d-ad31-9488c283422e with identifier: BX34768
2026-03-28 07:44:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17183509-0640-5e2d-ad31-9488c283422e with identifier: BX34768 to the API
2026-03-28 07:44:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:44:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:44:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:45:42Z',
'fuel_type': 'petrol',
'id': '17183509-0640-5e2d-ad31-9488c283422e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX34768',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 16740,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-14',
'seller_name': None,
'title': 'Fiat 500 1.2 Pop Star',
'transmission': 'manual',
'trim': 'Pop Star',
'year': 2018}
2026-03-28 07:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX34768%27 HTTP/1.1" 200 None
2026-03-28 07:44:14 [auto1.de] INFO: Saving data for BX34768: {'auction_closing_time': 1774716342.0, 'created_time': 1774349465.328535, 'last_price_update_time': 1774683854.260883}
2026-03-28 07:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX34768') HTTP/1.1" 204 0
2026-03-28 07:44:14 [auto1.de] INFO: Found listing with ID: SA81936
2026-03-28 07:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA81936%27 HTTP/1.1" 200 None
2026-03-28 07:44:14 [auto1.de] INFO: Scrape type for SA81936: 2
2026-03-28 07:44:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6543a61-abaf-57bc-85f3-6e55a931f1c1 with identifier: SA81936
2026-03-28 07:44:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6543a61-abaf-57bc-85f3-6e55a931f1c1 with scrape type 2
2026-03-28 07:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6543a61-abaf-57bc-85f3-6e55a931f1c1 with scrape type 2
2026-03-28 07:44:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6543a61-abaf-57bc-85f3-6e55a931f1c1, identifier: SA81936
2026-03-28 07:44:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6543a61-abaf-57bc-85f3-6e55a931f1c1 with identifier: SA81936
2026-03-28 07:44:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6543a61-abaf-57bc-85f3-6e55a931f1c1 with identifier: SA81936
2026-03-28 07:44:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6543a61-abaf-57bc-85f3-6e55a931f1c1 with identifier: SA81936 to the API
2026-03-28 07:44:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:44:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:44:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:51:55Z',
'fuel_type': 'diesel',
'id': 'c6543a61-abaf-57bc-85f3-6e55a931f1c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA81936',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 189681,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-28',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline 4Motion BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline 4Motion BlueMotion',
'year': 2013}
2026-03-28 07:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA81936%27 HTTP/1.1" 200 None
2026-03-28 07:44:14 [auto1.de] INFO: Saving data for SA81936: {'auction_closing_time': 1774716715.0, 'created_time': 1773945848.929467, 'last_price_update_time': 1774683854.67858}
2026-03-28 07:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA81936') HTTP/1.1" 204 0
2026-03-28 07:44:14 [auto1.de] INFO: Found listing with ID: CJ06587
2026-03-28 07:44:14 [auto1.de] INFO: Found listing with ID: UY61545
2026-03-28 07:44:14 [auto1.de] INFO: Found listing with ID: LV52918
2026-03-28 07:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV52918%27 HTTP/1.1" 200 None
2026-03-28 07:44:14 [auto1.de] INFO: Scrape type for LV52918: 2
2026-03-28 07:44:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2baa4285-e073-519c-a5e2-270229ff350c with identifier: LV52918
2026-03-28 07:44:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2baa4285-e073-519c-a5e2-270229ff350c with scrape type 2
2026-03-28 07:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2baa4285-e073-519c-a5e2-270229ff350c with scrape type 2
2026-03-28 07:44:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2baa4285-e073-519c-a5e2-270229ff350c, identifier: LV52918
2026-03-28 07:44:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2baa4285-e073-519c-a5e2-270229ff350c with identifier: LV52918
2026-03-28 07:44:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2baa4285-e073-519c-a5e2-270229ff350c with identifier: LV52918
2026-03-28 07:44:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2baa4285-e073-519c-a5e2-270229ff350c with identifier: LV52918 to the API
2026-03-28 07:44:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:44:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:44:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:24:46Z',
'fuel_type': 'petrol',
'id': '2baa4285-e073-519c-a5e2-270229ff350c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV52918',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 174982,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-21',
'seller_name': None,
'title': 'Skoda Fabia 1.2 TSI Joy',
'transmission': 'automatic',
'trim': 'Joy',
'year': 2016}
2026-03-28 07:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV52918%27 HTTP/1.1" 200 None
2026-03-28 07:44:15 [auto1.de] INFO: Saving data for LV52918: {'auction_closing_time': 1774715086.0, 'created_time': 1773136024.566533, 'last_price_update_time': 1774683855.081634}
2026-03-28 07:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV52918') HTTP/1.1" 204 0
2026-03-28 07:44:15 [auto1.de] INFO: Found listing with ID: DE56554
2026-03-28 07:44:15 [auto1.de] INFO: Found listing with ID: YE15667
2026-03-28 07:44:15 [auto1.de] INFO: Found listing with ID: CP43977
2026-03-28 07:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP43977%27 HTTP/1.1" 200 None
2026-03-28 07:44:15 [auto1.de] INFO: Scrape type for CP43977: 2
2026-03-28 07:44:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3abc42d-c754-5492-9a97-637e58f44563 with identifier: CP43977
2026-03-28 07:44:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3abc42d-c754-5492-9a97-637e58f44563 with scrape type 2
2026-03-28 07:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3abc42d-c754-5492-9a97-637e58f44563 with scrape type 2
2026-03-28 07:44:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3abc42d-c754-5492-9a97-637e58f44563, identifier: CP43977
2026-03-28 07:44:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3abc42d-c754-5492-9a97-637e58f44563 with identifier: CP43977
2026-03-28 07:44:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3abc42d-c754-5492-9a97-637e58f44563 with identifier: CP43977
2026-03-28 07:44:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3abc42d-c754-5492-9a97-637e58f44563 with identifier: CP43977 to the API
2026-03-28 07:44:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:44:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:44:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-28T16:49:20Z',
'fuel_type': 'diesel',
'id': 'f3abc42d-c754-5492-9a97-637e58f44563',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP43977',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touareg',
'odometer': 230472,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-30',
'seller_name': None,
'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
'transmission': 'automatic',
'trim': 'BlueMotion',
'year': 2014}
2026-03-28 07:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP43977%27 HTTP/1.1" 200 None
2026-03-28 07:44:15 [auto1.de] INFO: Saving data for CP43977: {'auction_closing_time': 1774716560.0, 'created_time': 1774596638.895696, 'last_price_update_time': 1774683855.555381}
2026-03-28 07:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP43977') HTTP/1.1" 204 0
2026-03-28 07:44:15 [auto1.de] INFO: Found listing with ID: MR29539
2026-03-28 07:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR29539%27 HTTP/1.1" 200 None
2026-03-28 07:44:15 [auto1.de] INFO: Scrape type for MR29539: 2
2026-03-28 07:44:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1377e7dc-1ca2-58df-a43f-a6f7991534d6 with identifier: MR29539
2026-03-28 07:44:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1377e7dc-1ca2-58df-a43f-a6f7991534d6 with scrape type 2
2026-03-28 07:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1377e7dc-1ca2-58df-a43f-a6f7991534d6 with scrape type 2
2026-03-28 07:44:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1377e7dc-1ca2-58df-a43f-a6f7991534d6, identifier: MR29539
2026-03-28 07:44:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1377e7dc-1ca2-58df-a43f-a6f7991534d6 with identifier: MR29539
2026-03-28 07:44:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1377e7dc-1ca2-58df-a43f-a6f7991534d6 with identifier: MR29539
2026-03-28 07:44:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1377e7dc-1ca2-58df-a43f-a6f7991534d6 with identifier: MR29539 to the API
2026-03-28 07:44:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:44:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:44:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:15:33Z',
'fuel_type': 'diesel',
'id': '1377e7dc-1ca2-58df-a43f-a6f7991534d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR29539',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 135606,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-25',
'seller_name': None,
'title': 'Seat Alhambra 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2018}
2026-03-28 07:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR29539%27 HTTP/1.1" 200 None
2026-03-28 07:44:15 [auto1.de] INFO: Saving data for MR29539: {'auction_closing_time': 1774714533.0, 'created_time': 1774596644.78858, 'last_price_update_time': 1774683855.980114}
2026-03-28 07:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR29539') HTTP/1.1" 204 0
2026-03-28 07:44:15 [auto1.de] INFO: Found listing with ID: TT64948
2026-03-28 07:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT64948%27 HTTP/1.1" 200 None
2026-03-28 07:44:16 [auto1.de] INFO: Scrape type for TT64948: 0
2026-03-28 07:44:16 [auto1.de] INFO: Found listing with ID: FN00007
2026-03-28 07:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN00007%27 HTTP/1.1" 200 None
2026-03-28 07:44:16 [auto1.de] INFO: Scrape type for FN00007: 2
2026-03-28 07:44:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c592b64-a120-5bf8-a3f5-8bb368b63cdd with identifier: FN00007
2026-03-28 07:44:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c592b64-a120-5bf8-a3f5-8bb368b63cdd with scrape type 2
2026-03-28 07:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c592b64-a120-5bf8-a3f5-8bb368b63cdd with scrape type 2
2026-03-28 07:44:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c592b64-a120-5bf8-a3f5-8bb368b63cdd, identifier: FN00007
2026-03-28 07:44:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c592b64-a120-5bf8-a3f5-8bb368b63cdd with identifier: FN00007
2026-03-28 07:44:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c592b64-a120-5bf8-a3f5-8bb368b63cdd with identifier: FN00007
2026-03-28 07:44:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c592b64-a120-5bf8-a3f5-8bb368b63cdd with identifier: FN00007 to the API
2026-03-28 07:44:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:44:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:44:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 160,
'expiration_date': '2026-03-28T16:52:09Z',
'fuel_type': 'petrol',
'id': '4c592b64-a120-5bf8-a3f5-8bb368b63cdd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN00007',
'listing': 'auction',
'make': 'Abarth',
'model': '595',
'odometer': 99371,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-29',
'seller_name': None,
'title': 'Abarth 595 1.4 Competizione',
'transmission': 'manual',
'trim': 'Competizione',
'year': 2013}
2026-03-28 07:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN00007%27 HTTP/1.1" 200 None
2026-03-28 07:44:16 [auto1.de] INFO: Saving data for FN00007: {'auction_closing_time': 1774716729.0, 'created_time': 1774596643.906591, 'last_price_update_time': 1774683856.387438}
2026-03-28 07:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN00007') HTTP/1.1" 204 0
2026-03-28 07:44:16 [auto1.de] INFO: Found listing with ID: MD24285
2026-03-28 07:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD24285%27 HTTP/1.1" 200 None
2026-03-28 07:44:16 [auto1.de] INFO: Scrape type for MD24285: 2
2026-03-28 07:44:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e07fc65e-c9a1-5b75-8077-a7314b6c2f13 with identifier: MD24285
2026-03-28 07:44:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e07fc65e-c9a1-5b75-8077-a7314b6c2f13 with scrape type 2
2026-03-28 07:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e07fc65e-c9a1-5b75-8077-a7314b6c2f13 with scrape type 2
2026-03-28 07:44:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e07fc65e-c9a1-5b75-8077-a7314b6c2f13, identifier: MD24285
2026-03-28 07:44:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e07fc65e-c9a1-5b75-8077-a7314b6c2f13 with identifier: MD24285
2026-03-28 07:44:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e07fc65e-c9a1-5b75-8077-a7314b6c2f13 with identifier: MD24285
2026-03-28 07:44:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e07fc65e-c9a1-5b75-8077-a7314b6c2f13 with identifier: MD24285 to the API
2026-03-28 07:44:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 07:44:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 07:44:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 179,
'expiration_date': '2026-03-28T16:33:58Z',
'fuel_type': 'diesel',
'id': 'e07fc65e-c9a1-5b75-8077-a7314b6c2f13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD24285',
'listing': 'auction',
'make': 'Citroen',
'model': 'Jumpy',
'odometer': 144108,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-24',
'seller_name': None,
'title': 'Citroen Jumpy 2.0 Blue-HDi Club M',
'transmission': 'automatic',
'trim': 'Club M',
'year': 2019}
2026-03-28 07:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD24285%27 HTTP/1.1" 200 None
2026-03-28 07:44:16 [auto1.de] INFO: Saving data for MD24285: {'auction_closing_time': 1774715638.0, 'created_time': 1774348523.608213, 'last_price_update_time': 1774683856.874649}
2026-03-28 07:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD24285') HTTP/1.1" 204 0
2026-03-28 07:44:16 [auto1.de] INFO: Found listing with ID: PZ15198
2026-03-28 07:44:16 [auto1.de] INFO: Found listing with ID: CS43081
2026-03-28 07:44:16 [auto1.de] INFO: Found listing with ID: VK35465
2026-03-28 07:44:16 [auto1.de] INFO: Found listing with ID: XB83488
2026-03-28 07:44:16 [auto1.de] INFO: Found listing with ID: PB97983
2026-03-28 07:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB97983%27 HTTP/1.1" 200 None
2026-03-28 07:44:16 [auto1.de] INFO: Scrape type for PB97983: 0
2026-03-28 07:44:16 [auto1.de] INFO: Found listing with ID: GX91022
2026-03-28 07:44:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 07:44:17 [auto1.de] INFO: Channel: 24h | Page: 233 | totalHits: 9266 | hits on page: 0
2026-03-28 07:44:17 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 07:44:17 [auto1.de] INFO: auto1.de Batch config: batch 1/2
2026-03-28 07:44:17 [auto1.de] INFO: auto1.de Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 1, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 1, <ScrapeType.BATCH_SKIPPED: 5>: 5}
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20last_price_update_time%20lt%201774251857 HTTP/1.1" 200 None
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AB49133') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AC93351') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AD02710') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AD51126') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AD78216') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AF31907') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AG46303') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ11888') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ27705') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ57817') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AK05068') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AK26500') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AL36767') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AM20161') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AR08419') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AR37862') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AR94395') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AS32942') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AW63881') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AW88722') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AW88873') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BC85284') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BG42880') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ24528') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ25781') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BL10422') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BL47200') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BP15722') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BP66239') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BR79409') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BR80178') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BT46433') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BU21003') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BV82977') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BW01020') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BW28683') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BY24352') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ15195') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ34179') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ57101') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CB58662') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CD24359') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CE58058') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CE68087') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CF28122') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CG43606') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CG72347') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CN00053') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CN07449') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CN43056') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CR42013') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CR60975') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CS45393') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CW95921') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CX32228') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CY27659') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CY43451') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DB56304') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DC23671') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DC27012') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DC44545') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DC65232') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DD00982') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DD46033') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DD72625') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DG46200') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DH90644') HTTP/1.1" 204 0
2026-03-28 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ48491') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DK37949') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DK97304') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DL53610') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DM55805') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DP68813') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DR45963') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DS20438') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DS51520') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DT59270') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DV18100') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DW77268') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ53558') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ74108') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EA52308') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EC03707') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EC22234') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EC43020') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EF75873') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EG38702') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EH57829') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EH91582') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ51450') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ89782') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EK32140') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EK48004') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EL96080') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EP64262') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ER69685') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ES61552') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EV09512') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EV18580') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EW67018') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EX88283') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FA90305') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FB03313') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FC29458') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FE62080') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FG33427') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FG48980') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FG83238') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FH21065') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ33097') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ35722') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ99694') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FL33227') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FL62048') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FM86230') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FN67126') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FP98756') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FT10975') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FU18032') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FV03828') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FW19107') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FW24707') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FX21389') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FY29044') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FY71242') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ77972') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GB49809') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GC27939') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GC66002') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GD29053') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GF48605') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GF48923') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GH45576') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GK19144') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GK39429') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GR32471') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GR63466') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GR96041') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GT32005') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GT73372') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GT97626') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GU21769') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GV90965') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ33681') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ42240') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ59743') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HE53793') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HF64841') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HG43188') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HG62785') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HH06006') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ46135') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HL66974') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HM10485') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HM38388') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HP30052') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HR72969') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HS55924') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HS78450') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HT22196') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HU11516') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HU22940') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HX28462') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HY54924') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ55109') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JA12615') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JA13261') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JB30595') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JC83845') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JC97343') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JD26804') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JD65784') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JM65569') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JN82079') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JR52179') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JR73784') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JT87226') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JW95540') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JX55294') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JY61611') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ47506') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KA75739') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KA94149') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KB24676') HTTP/1.1" 204 0
2026-03-28 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KB62882') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KB68354') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KC33777') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KD86114') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KD88298') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KE06488') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KE41699') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KF08107') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KH40392') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KK32088') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KL72541') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KM17376') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KN56356') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KP36820') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KP85350') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KT17856') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KV33816') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KV36004') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KV78740') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KX94839') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ16493') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LA45428') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LC18575') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LD44178') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LD49637') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LD90421') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LE05850') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LE99206') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ21578') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ26798') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ43489') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LK60107') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LS93949') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LT01381') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LT85175') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LV17294') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LW53889') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LY96879') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MA05415') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MA50962') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MB11213') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MD36296') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MF60875') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MG61619') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MH55571') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MH64159') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MK10095') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MK22023') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MK72976') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MM73538') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MP51642') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MR05014') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ45234') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NA26291') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NC68705') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NE48651') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NF89910') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NG50641') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NH48980') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NK48490') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NK54190') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NR34537') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NS83554') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NT05131') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NT31981') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NT95392') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NV30450') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NV89661') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NW92162') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NY30954') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NY62585') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ30285') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PA36116') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PC47830') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PC77410') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PC85899') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PC88628') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PF77746') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ09031') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PK47763') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PK77485') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PM44587') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PN09435') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PP81333') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PR13867') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PR84297') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PR86742') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PU69799') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PV80087') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PW64692') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PW96816') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PX36721') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PX49171') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RA96875') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RB79474') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RD46007') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RE26285') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RF00811') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RF59698') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ72897') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RM27503') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RN86577') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RP06168') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RP21805') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RR73690') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RS18612') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RT19979') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RT35793') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RU25678') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RU85035') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RV56462') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SB19862') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SD78048') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SD84227') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SE38969') HTTP/1.1" 204 0
2026-03-28 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SE80616') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SF81844') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SG74229') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SL92984') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SN24539') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SS02832') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SS62635') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ST24513') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SU04128') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SV41161') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SW06849') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SX52184') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ36632') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TA62748') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TA80725') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TE91129') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TH66744') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ85796') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TK93923') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TL05412') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TL86180') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TP91786') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TR37501') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TR68176') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TU19465') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TU93300') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TV02686') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TV45930') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TX30330') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TY06085') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ25189') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UB99519') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UE51807') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UF03546') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UG01965') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ06873') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ60221') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UK62996') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UK79863') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UK91984') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UM04088') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UM98970') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UP35027') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UP35116') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='US19272') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UU72969') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UY04884') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ33381') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VC55223') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VC76519') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VC83549') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VE07777') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VE13678') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VF00906') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VG58612') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VH04826') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ09996') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ29024') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ71106') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VK36740') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VL97674') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VM75790') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VN03026') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VP19374') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VR10102') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VR31576') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VW07399') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ21496') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WA68058') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WB04008') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WB54343') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WD41538') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WE89177') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WG52031') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ07868') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ67055') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WL92836') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WN10865') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WP80129') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WR67202') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WS15050') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WS55297') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WS62420') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WV99544') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WW02513') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WW29948') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WW51368') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WY05017') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WY19151') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XA77747') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XB34738') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XD31718') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XT31842') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XU14392') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XU99137') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XW87152') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ79708') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YA51682') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YB04799') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YD16382') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YE24929') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YG35577') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YH11086') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YH43651') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YH94591') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ01874') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YK83419') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YS85982') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YV85598') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ65582') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA01258') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA80746') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF33601') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH74852') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ02034') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM17001') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS74444') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT52694') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU63798') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV11386') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW83329') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY67532') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ25386') HTTP/1.1" 204 0
2026-03-28 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ54313') HTTP/1.1" 204 0
2026-03-28 07:44:21 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (499 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.de/task_17_2026-03-28T07_30_00.jl
2026-03-28 07:44:21 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 713454,
'downloader/request_count': 249,
'downloader/request_method_count/GET': 14,
'downloader/request_method_count/POST': 235,
'downloader/response_bytes': 54482194,
'downloader/response_count': 249,
'downloader/response_status_count/200': 249,
'dupefilter/filtered': 1,
'elapsed_time_seconds': 854.446925,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 28, 7, 44, 20, 973232, tzinfo=datetime.timezone.utc),
'item_scraped_count': 499,
'log_count/DEBUG': 13833,
'log_count/INFO': 18332,
'memusage/max': 173572096,
'memusage/startup': 148242432,
'photo_download_count': 10,
'request_depth_max': 236,
'response_received_count': 239,
'scheduler/dequeued': 249,
'scheduler/dequeued/memory': 249,
'scheduler/enqueued': 249,
'scheduler/enqueued/memory': 249,
'scrape_type/batch_skipped': 4658,
'scrape_type/new': 1,
'scrape_type/price_update': 498,
'scrape_type/skipped': 4148,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 239,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 2.741890443629238,
'scrapy-zyte-api/mean_response_seconds': 2.885111653483689,
'scrapy-zyte-api/processed': 239,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 239,
'scrapy-zyte-api/request_args/experimental.requestCookies': 238,
'scrapy-zyte-api/request_args/experimental.responseCookies': 239,
'scrapy-zyte-api/request_args/httpRequestBody': 235,
'scrapy-zyte-api/request_args/httpRequestMethod': 235,
'scrapy-zyte-api/request_args/httpResponseBody': 239,
'scrapy-zyte-api/request_args/httpResponseHeaders': 239,
'scrapy-zyte-api/request_args/sessionContext': 239,
'scrapy-zyte-api/request_args/url': 239,
'scrapy-zyte-api/status_codes/200': 239,
'scrapy-zyte-api/success': 239,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'source/items_encountered': 9306,
'source/total_available': 9266,
'start_time': datetime.datetime(2026, 3, 28, 7, 30, 6, 526307, tzinfo=datetime.timezone.utc)}
2026-03-28 07:44:21 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 07:44:21 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f0800db5590>
2026-03-28 07:44:21 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f0800ee3cd0>